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modern organizations. We have conducted an empirical study in which groups of three 
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solving and the other involved GDSS-aided face-to-face problem solving. Our study 
expanded the research of Fijol and Woodbury and thus, we replicated the conditions of 
their experiment. In support of a major premise of our model, we found that the case 
used Was too simple to be efficiently solved using a GDSS. Further research is 
necessary to define precisely which characteristics and settings are best used to support 
each problem type and to make GDSS a useful management tool. 

Research has suggested that a wide range of options may be included in a GDSS 
and that there are several possible settings for its use. Not all settings and options, 
however, are feasible for all problem types. In addition to our study, we have 
developed a model, based on problem type, that recommends optimal settings and 
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I. INTRODUCTION 


In organizations today a major issue for top management is coping with the 
Scarcity of resources. One scarce resource often overlooked is management itseif. In 
growing organizations, managers are often hard pressed to contend with the number of 
meetings and day-to-day decisions they face. When crises occur the problem is 
compounded. Adding more managers does not necessanly heip the situation. Due to 
the difficulty in finding competent managers, and because the addition of managers 
often complicates communication interfaces, more complexity is created which can 
actually exacerbate the original problem. One answer io this dilemma is to discover 
new wavs to make more effective use of the scarce resource. a manager's decision- 


making time. 


ae da Ee FOR GROUP DECISION SUPPORT SYSTEMS 


Research in the area of Management Information Systems (MIS) reveals a need 
for more efficiency in collecting, disseminating and using information in organizations. 
A study of MIS research between 1972 and 1982, conducted by Culnan, indicated that 
one of the emerging research trends of the time period was the use of Decision Support 
Systems (DSS) [Ref. 1]. In general, the concept of a DSS is to provide an interactive 
end-user-oriented svstem to facilitate the solution of complex, unstructured problems. 
These svstems are distinguisned from other Management [nformation Systems because 
they ciace an empnasis on decision modeis and databases [Ref. 2: pp. 31-82]. It must 
Sewer dasized tiat wie DSS s role is to facilitate decision making, not to replace the 


manager. 


Since that time there has been a large volume of new research in the field of 
DSSs. in general. and in a subset oi this area. Group Decision Support Systems 
(GDSS), which is the focus of our research. We chose GDSSs because group decisions 
are considered to be of increasing importance since some of the most critical 
organizational issues require a consensus to ensure implementation [Ref. 3: p. 3], and 
ewes sidi it IsepOssibie (Or a GWSs .o enhance group process. GDSS is a subset of 


the DSS field that is specifically oriented towards the support of group decisions and 


collective problem solving. DeSanctis and Gallupe have defined the group and the 
group's role to be 


two or more people who are jointly responsible for detecting a problem, 
elaborating on the nature of the problem, generating possible solutions. 
evaluating potential solutions, or formulating strategies for implementing 
solutions. The members of a group may or may not be located in the same 
physical location, but they are aware of one another and perceive themselves to 
be part of theysroup. | R¢e. bp. 590] 


The purpose of 2 GDSS is to improve the erficiency of group decision making, or to 
decrease the amount of meeting time. and to improve the quality of thetdecision in 
some way. Designers have attempted to achieve this goal by studying group process 
and discovering ways to incorporate existing behavioral models. problem soiving 


methodologies, and communications enhancing techniques into the GDSS. 


Interest in developing a system to support managerial decisions began during the 
1970’s. At that time there were a few DSSs available for use on a mainframe. The 
advent of the microcomputer during the late 1970’s and early i980’s, and the 
improvements in technology that allowed for faster processing and larger memories, 
encouraged the proliferation of spreadsheet programs, database management svstems 
and software used to support decision-making. Recently, a more complex architecture 
for DSSs has evolved that includes the following components: a Dialogue Manager 
(that controls the user/computer interface), a Model Manager (that controls the 
decision-making models), and a Data Manager (that controls the databases used to 
support the decision). In order to provide an architecture that is suitable for group 
decision support another component, the Communications Mianager (that enabies 
distributed group decision-making by controljing communications between multiple 
users) has been added [Ref. 2: p. $2]. As can be seen from this bnef chronology, the 


evolution of a GDSS has been very recent. 


In the past much research has been conducted to determine the factors that are 
important to the design of Decision Support Systems. These studies have concentrated 
primarily on Individual Decision Support Svstems (I1DSS), rather than on Group 
Decision Support Systems (GDSS). IDSSs have existed tor several vears and are 
commercially available for use on a wide range of systems (from personal computers to 
mainframes}, however, the concept of a GIDSS has oceumedsemmeaecent: es rceer 


technology 1s not vet matttre, m fact, the majOnmiy 01 (Ib sos se dstecmene coat 
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purposes and are not yet commercially available. A major barrier preventing these 


systems from reaching maturity is that several basic design: issues are still unresolved. 


The initial approach to designing a GDSS has been to adapt existing decision 
making models or to create new models on which to base the designs. A number of 
GDSSs have been developed recently that have been based on several different decision 
making models. A summary of the different decision making models used follows: 


I, Nominal Group Technique - This technique involves anonymous generation of 
ideas, round robin listening to ideas, discussion and clarification, and voting and 
prioritization of ideas [Ref. 2,5: pp. 82, 588]. 


3 


-. Consensus \iapping - This method allows users to structure ideas ov producing 
a graphic map of interrelationships among individual ideas and to rearrange and 
supplement ideas as required [Ref. 5: pp. 587-598]. 


Ua 


Analytic Hierarchy Processing - In this method, complex decision problems are 
arranged into a nierarchy, with the goal at the topmost level and the lower 
levels elaborating on the goal (Ref. 6: pp. 494-495]. 


ome cium ysccS - ScCvefal Fescarchers are excited about the possible 
incorporation of an expert’s knowiedge into a GDSS. These systems are 
specially designed to solve problems by using rules and _ heuristics. 
[Ref. 7,8,9,10: pp. 936, 22, 474-477, 458]. 

Organizational changes to which the new GDSS technology must respond will 
include the need for faster and more frequent decision making, the need for more 
frequent innovations, and the need for organizational information gathering that is 
continuous and more wide-ranging than before [Ref 7: p. 932]. More effective 
electronic support will be necessary because group decision making will be required 
more frequently to deal with the additional complexity, and there will be resistance to 
meetings because thev are time consuming and inefficient. Mintzberg has stated that 
the manager’s current decision making environment is poor and that managers require 
a systematic means for sharing information (Ref. 11: p. 60]. In the future Group 
Decision Support technology will change this so that meetings will become more 


efficient and the decision process will become more structured. 


B. ADVANTAGES AND DISADVANTAGES OF USING A GDSS 


Several authors have suggested that the very nature of society is in transition 
from the industrial-based society, with which we are familiar, to an information-based 
society (Ref. 4,7,12.13,: pp. 509. 932-937, 109, 13]. The post-industrial society 1s 
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characterized by a great deal of complexity and turbulence. This is caused by the rapid 
growth in the cumulative knowledge of society. In order to handle the ever increasing 
knowledge base, technology will improve and there will be more social and economic 
diversity, which will lead to societal interdependence and specialization [Ref. 7: p. 937}. 
Because people have a limited capacity for attention [Ref. 14: p. 271], the new 


technology must permit the manager to screen out unimportant data. 


With the goal of improving the effectiveness and efficiency of group decision 
making in mind, there are advantages to using on-line systems to support decision 
making. Especially in solving complex problems, the use of a GDSS enables the 
problem to structure the decision making process with the use of models and 
databases, rather than to be limited by the lack of available tools to manipulate data 
fRef. lS somes 


Rapid turnaround is also a key advantage in using on-line svstems. Specifically, 
Alter lists the following advantages to rapid turnaround: 
le Ouick response Vorguencs: 


2. Few interruptions while waiting for a response thus preventing the user from 
breaking his or her train of thought. 


Consideration of more alternatives is possible because more tests can be run. 
4. Debugging is less frustrating because jobs can be rerun more quickly. 


It is essential for real time operations. [Ref. 12: pp. 112-113] 


Research conducted on the differences between group and individual problem 
solving has indicated that group problem solving has many advantages over individual. 
Groups have been shown to be better than individuals in solving problems that lack 
structure [Ref. 16: p. 82]. Other group strengths include the ability to handle 
assumptions, the ability to facilitate communications about conflicting ideas, an 
increased understanding of alternatives, and creativity in decision making [Ref. 17: p. 
267}. Although there are advantages to the group process. the drawback of increased 
communications requirements for groups cannot be overlooked. It is necessary for 
Gilss designs to capitalize on the benefits of group processes while minimizing the 


expense of communications requirements. 


Although there are advantages to using a GDSS in decision making, numerous 
disadvantages have been noted. Kafoglis enumerates the major drawbacks to using 


DSSs as time and expense of data gathering, management’s lack of time and interest to 


lz 


learn about the systems, difficulty integrating components like statistical packages, 
graphics, and databases, and the fact that DSS departments do not have the right 
personnel for designing DSSs [Ref. 18]. To this Alter adds the concentration on 
technical issues rather than actual uses for the system, and the lack of support from the 
decision makers as stumbling blocks to the use of GDSSs [Ref. 19: pp. 97-98]. In 
addition, Van de Ven and Delbeca list the following pittails to group problem solving: 
the “focus effect” that causes groups to “get in a rut”, self-weighting, covert judgments. 
pressure involving the status of group members. conformity pressure. domineering 
personalities, expenditure of additional effort to maintain the group and ithe tendency 
to rush into a decision without fuily considering alternatives {Ref. 20: p. 206]. When 
considering implementing a GDSS, managers must weigh the possible pitfalis against 
the benefits of GDSSs, keeping in mind that special design provisions are possible to 


reduce or eliminate the impact of manv of the disadvantages. 


C. DESIRABLE CHARACTERISTICS OF A GDSS 


The designer of a GDSS must consider the major functional requirements of the 
system and be aware of the overali goals of the GDSS. Many authors have 
commented on the necessary functions for a system to be considered acceptable. 
DeSanctis and Gallupe claim that the important characteristics of a GDSS are: 


1. The GDSS is a specially designed system, not mereiy a configuration of alreadv 
existing svstem components. 


2. A GDSS 1s designed with the goal of supporting groups of decision makers in 
their work. sAs such, the GDSS should improve the decision making process 
and/or decision outcomes or groups over that which would occur if the GDSS 


Were 0t present. 
A GDSS is easy to tearn and easy to use. it accommodates users with varying 


1e 
leveis of knowledge regarding computing and decision support. 


Loy) 


ete ie oemay be speciiic {designed for one type or class of problem) or 
“general” (designed for a variety of group-level organizauonal decisions). 


Csy 


The GDSS contains builit-in mechanisms which discourage the deveiopment of 
megative group behaviors. such as destructive conflict. miscommunication, or 
‘groupthink’. [Ref. 21: p. 4] 
In addition to the characteristics listed above, DeSanctis and Gallupe nave 
suggested that a GDSS be capable of supporting the following activities: the abilitv to 


accommodate a wide range of decision processes in groups, the ability to pian 
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meetings, support of both task and social needs, recognition that different groups have 
different patterns of interaction depending on the task and the individuals involved 
[Ref. 4: p. 592]. Alter has stated that interaction with the GDSS is not the most 
important aspect of the system. Instead, designers should direct their energies towards 
responsiveness of the system. Responsiveness is a combination of power (the svstem’s 
ability to answer the most important questions), accessibility (the ability to provide 
answers quickly and consistently), and flexibility (the abilitv to adapt to changing 
needs) [Ref. 12: p. lid]. Improving the responsiveness of the system will make the 


group process more efficient in keeping with the goal of GDSS design. 


The addition of flexibitity in the design of GDSS has recently become an 
Important issue. The newness of GDSS technology and the research that is being 
conducted in the area of improving GDSS eifectiveness indicate that there is a need for 
flexibility. Because new patterns for the use of a GDSS tend to evolve, Rathwell and 
Burns have found that permitting the addition. deletion and modification of functions 
in a GDSS to be necessary [Ref. 17: p. 268]. Keen and Gambino have recognized that 
there 1s a need to design the imitial svstem with procedures very similar to the wav 
users work without a GDSS but, as users learn, to permit growth and change 
[Ref. 22: p. 152]. [t has also been recognized that system flexibility will allow the 
system to be generalized to a variety of problems [Ref. 23: p. 20]. There is a problem. 
_however, in providing the required flexibility in that once a need to change the system 
is recognized there is a delay in the time required to implement that change [Ref. 24: p. 
1S2 


A concept in GDSS design that is relatively recent is that of creating a shell” 
that will allow the users, through a facilitater, to customize the characteristics of the 
GDSS. DeSanctis and Gallupe propose that because Of ineicempic ame mene eee 
lack of definitive research on group dynamics, and the inherent variability of groups, 
the use of a menu-driven “shell”, from which a group may select features specific to the 
task must necessarily replace the idea of providing a generalized GDSS design concept 
[Ref. 4: p. 596]. DeSanctis and Dickson plan to do extensive research on such a “shell” 


SVSteI HRCI Neos pe ooo 


14 


D. PURPOSE OF THE THESIS 


Our experimental study is based on research conducted by Fijol and Woodbury 
in which they tested groups in two different settings. The first setting was a face-to-face 
group meeting with a GDSS and the second setting was a group that used a GDSS ina 
distributed setting, that is, group members met individually and never discussed the 
problem as a group. Their test was conducted on a total of twelve groups of three 
members, six groups in each setting. Each group was asked to solve a case studv using 
a GDSS with the assistance of a chauffeur, who physicallv interfaced with the GDSS. 
Their purpose was to ”.. . determine how the use of a GDSS would affect the decision 
outcome variables of distributed groups... and non-distributed groups” [Ref. 26: p. 
9]. 


In our study, we selected two different settings. In the first, groups met face-to- 
face with a GDSS and in the second, groups met face-to-face without any computer 
support. We studied a total of eighteen groups of three members, twelve groups with 
the GDSS and six groups without the GDSS. In order to improve the statistical 
significance of our study, we carefully replicated the Fijol and Woodbury study, with 
the exception of setting, and combined the outcomes of their six face-to-face GDSS 
groups with our six face-to-face GDSS groups. The same case study was used as a 
decision task and subjects were drawn from a similar population. Our effort was to 
determine the effect of solving the task using GDSS support versus not using a 
computer. The subjects in groups that used a GDSS, used Co-oP, which is the same 
GDSS used in the Fijol and Woodbury study. The same decision outcome variables 
Were used to measure the results in our experiment as were used in the Fiyol and 
Woodbury study including decision quality, input speed. and group satisfaction with 


the decision. 


Furthermore, it was our goal to review issues relevant to the design and 
suiecessiul use of a GDSS. Ideas pertaining to the design of a successful GDSS that 
have appeared in recent research are discussed. In addition. we propose a model. 
oased on problem type, that recommends the use or non-use of a GDSS, an optimal 


setiing, and design features for each problem type. 


fS 


II. DESIGN ISSUES FOR GDSS EMPIRICAL STUDIES 


Because it is a relatively new field, little research has been conducted that directly 
pertains to GDSSs. The use of controlled experiments and non-experimental studies 
on existing GDSSs can help to improve future designs and the utility of present 
svstems. While both controlled experiments and non-expenmental studies provide 
valuable information. experimental designs permit researchers to determine causal 


relationships and are of more use in testing hypotheses [Ref. 27: p. 412]. 


In an experimental design the investigator creates a condition in which he or she 
can manipulate one variable (the independent variable), and measure the associated 
change in another variable (the dependent variable). Although this seems a simple 
enough task, there are many potential pitfalls in using experimental designs, especially 
When human behavior is measured. It has been noted that no firm rules have been 
associated with the conduct of high quality research on human behavior. Instead, 


“research is learned by doing and is taught mainlv by contagion.” [Ref. 27: p. 409] 


Experimental research on GDSSs must be conducted in light of the fact that 
most eXisting systems are composed of a number of components and that there is a 
synergistic effect among the components. Research should concentrate on the whole 
system, rather than on individual parts, to be valid [Ref. 28: p. 28]. This requires that 
decision problems used for testing have a sufficiently broad range to test most of the 
features of a GDSS. If design errors are found through research on GDSSs. it 1s ikelv 
that they are of one of two types, either the system dces not incorporate needed 
capabilities or the svstem is providing capabilities that are not cost effective [Ref. 29: o. 
197]. 


A. DESIGN OF GDSS STUDIE 
Gallupe has stated that it is important to conduct research on GDSSs so that the 
types of tasks and appropriate features to be supported by GDSSs can be defined. He 
further notes that the design of GDSS experiments is somewhat specialized and cites 
four areas that are of interest to researchers: 
1. The nature of the decision task. 


2. The development of a GDSS to support group decision making. 
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3. The experimental setting and subjects. 


4. The types of dependent variables and their measurement. [Ref. 30: pp. 515-516] 


The group decision task is a problem, or problems, selected by the experimenter 
that is to test the overall use of the dependent variables. Many existing case studies 
are available from management texts and often nave the advantage of having a 
suggested solution bv the author. Alter chose to write his own case studies to test 


decision support svstems but found drawbacks to this approach: 


it certainly isni obvious whether any actionabie conclusions can be drawn by 
comparing these situations. Worse vet. it isn’t even clear whether there are 
Variables Or paiterns which can be used to compare them im the first piace. 
| rewees: p. 29] 


When sefecting an existing case study for an experiment it should have the following 
Cnaracteristics: face validity, content validity, external vatiditv, and it must be suitable 


lomeuppore ey a GUSS fRef. 30: pr sia 


ine GDSS selected for use in an empirical studv may be either “generai” or 
“specific”. Lewis developed his system, Facilitator, specificaily to support tasks that he 
had chosen to study [Ref. 31: p. 78]. Bui, however. developed Co-oP as a multi-criteria 
decision making tool that would be suitable for solving a wide range of problems 
[Ref. 52]. For our experiment Co-oP was selected because it was used by Frol and 
Woodbury tn their research (Ref. 26: p. 18}. 


. 


Both subject and setting for an empiricai study are concerns of a GDSS 
researcher. Finding an adequate number of willing subjects who are suitable for the 
experiment and ‘who have relatively homogenous backgrounds is necessary. 
Researchers may study specific cnaracteristics of subjects. like age. sex, or management 
@Moerience, OF they may chose subjects randomly. The iogistics of setting 1p group 
meetings. especially when large groups are involved. can be difficult. For our 
experiment we used groups of three to replicate the Fijol- Woodbury study [Ref. 26: p. 
LS]. 

The selection 01 2 setting, or settings, is a detail that is often mitigated bv the 
availability of meeting space, software, and hardware. Ifa distributed system is tested. 
there may be requirements to establish networking capabilities or other special 
nardware configurations [Ref. 30: p. 317]. In addition, the setting should be 


daestheticaliy pieasing, comfortabie. and flexible enougn for muitiple uses. and the 
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software, hardware, and protocols should be well-defined and provide adequate support 
[Ref. 33: pp. 124-128]. 


Experimenters must select a valid set of measurements and determine operational 
definitions of each before conducting the study. DeSanctis, Gallupe and Dickson 
duiferentiate between decision outcome variables (such as, decision quality, decision 
time, decision confidence, satisfaction with the group process, and amount of GDSS 
usage), and decision vrocess variables (such as. the number of issues considered, the 
number of aiternatives generated, and the amount of participation in decision making) 
(Ret. 34: p. 82]. Most importantly these variables must be defined in terms that are 
concrete and well-defined, so that, uf another researcher decides to replicate the study, 


it is clear to him or her what was measured and how the measurements were obtained. 


B. VALIDITY AND EXPERIMENTAL DESIGN 


The objective of performing experimental research on GIOSS5 1s)te develagnmiac. 
in which there is some measure of confidence. Validity is tne term used to express 
confidence in a study. Brinberg and McGrath have described validity as having three 
somewhat different meanings. The first is correspondence. or how well the internal 
variables of the study are related. A second is robustness, or how weil the results can 
be generalized to other situations. Finally, there is value, or how well the elements and 
relationships provide substance, concepts and methods for study {Ref. 35: p. 6]. A 


good experimental design will incorporate all three meanings. 


Four main types of validity have Seen defined to assist in determining the vaiue 
of an experimentai studv. Internal vaiidity is the extent to which a causal relationship 
can be determined among independent and dependent variabies. Externai validity is 
the extent to which the results can be generalized outside of the experimental setting. 
Construct validity is the extent to which independent and dependent variables represent 
theoretical constructs. Finally, conclusion validity 1s the extent to which the statistical 


cONCIUSIONS Of 4 Stbdysane accUratem Reino, ome! 


C. PROBLEMS IN EXPERIMENTAL DESIGN 


When dealing with experiments that attempt io measure human behavior, a high 
level of compiexity is encountered, leading to a variety of different problems. Often 


interactions, between thesexpernmenter, the subjects, andmieescttmerancsoveroo cd 
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Friedman suggests that several variables have an impact on experiments but are rarely 
controlled, including experimenter appearance, the way in which subjects are greeted, 
how well subjects and the experimenter know each other and the setting (different 
Goems Can Cause a difference m the outcome) (Ref. 37: pp. 74-83]. In addition, 
fakability (where participants deliberately fake answers to questionnaires or other 
behavioral measures), and response sets (in which subjects consistently overrate. 
uncerrate or provide socially acceptable answers) have been cited as problems 
(Ref. 38: p. 204]. In replications of studies, the impact of such variables can often lead 
to significantly different research conclusions derived from similar populations of 


sub]ecTS. 


Face validity is a further concern of experimenters. In a study with low face 
validity, the experimenter and the subjects disagree on either the cause of a behavior, 
the effect of a behavior, or on the meaning of events [Ref. 39: pp. 41-42]. 
Disagreement of the subjects with the conclusions of the researcher can often call the 
validity of the experiment into question because it is possible that the experiment lacks 
internal validity or construct validity. Efforts to control and document problematic 


variables must be made to improve the reliability of experimentation. 


Replication has been cited as being very important because it 1s a means to 
control these problems and to verify and validate experimental results. The replication 
of a study can help to rule out alternative explanations for relationships between 
independent and dependent variables, and thus strengthen causal relationships. 
Conversely, they can provide contradictory results that might lead to new ideas about 
the relationships among variables [Ref. 27: pp. 413-427]. Although the benefits of 


replication are obvious. few oublished replications of experiments exist. 


D. ISSUES IN THE MEASUREMENT OF BEHAVIOR 


Because experimental design for GDSSs involves the participation of groups, it 1s 
necessary to consider reliable methods of measuring the behavior of the groups tested. 
The first task is to develop a concrete operational definition of the behavior that 1s 
being measured [Ref. 40: p. 43]. For example, decision quality 1s defined in our 
research as whether a group has agreed with the experts’ solution to the case. The 
researcher must next decide how best to measure the behavior. Five approaches cited 


by Cozby include archival data, self-report measures (interviews or questionnaires), 
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behavioral measures (direct observations of behavior by a researcher), physiological 
measures, and field observations (the researcher makes observations in a natural setting 
over a long period of time) (Ref. 40: pp. 44-54]. In GDSS research the most frequently 
used approaches are self-report and behavioral measures. Self-report, via 


questionnaires, is the method we selected for our study. 


In general, the data obtained from GDSS experiments is ordinal type. That is, 
the absolute vaiues of the numeric data from a group is not meaningful, except in 
comparison to the other groups [Ref. 27,31: pp. 434, 78]. This does not imply that the 
data itself is not meaningful, oniv that direct numeric comparisons cannot be made. 
For example, it can’t be said that someone who agreed strongly with two statements 
that are positive towards a GDSS is half as favorable towards a GDSS as someone 
who agreed strongly with four positive statements. Therefore, ordinal measures have 


some limitations. 


fil. AN EXPERIMENTAL RESEARCH DESIGN: 
GDSS VERSUS NON-GDSS 


moe tt LING 


In GDSS research, four possible decisinn making settings have been cited: 


1. Face-to-face GDSS - A group meeting face-to-face with GDSS support. 


ty 


Face-to-face non-GDSS - A group meeting face-to-face without GDSS support. 


{aa 


Distributed GDSS - Group members do not meet in the same location or at the 
same time. Instead, they independently provide input to a central GDSS at 
their convenience. 


4. Distributed non-GDSS - Group members independently provide input to a 
centrai decision maker who compiles the results without the use of a GDSS. 
(Rer. 41] 

Since the concepts involved in the design and use of GDSS are new. a large 
amount of basic research is needed to pave the way for effective systems. The 
experiment we designed was based on research conducted by Fijol and Woodburv 
(Ref. 26]. Their studv tested a total of twelve groups, all solving the same case. The 
groups were evenly split between two settings: | 

@ faee-io-iace GDSS 


@ distributed GDSS 


We similarly chose to evaluate a decision task in two settings, but varied one 
setting from what thev used: 
M™ iace-to-face GDSS 


Me ece-1o-1ace Non-GODSS 


In order to expand on the Fijol-Woodburvy research, our experiment studied a 
total of 2ignteen groups: six face-to-face GDSS and twelve face-to-face non-GDSS. 
We carefully replicated many or the details of the Fijoi-\Woodbury study (e.g., similar 
groups Of three Were used to solve the same task that they chose) so we could combine 
che resuits of their six face-to-face GDSS groups with our six face-to-face GDSS 
groups. This enabied us to use their data to improve the statistical significance of our 
project as weil as verify some of their ‘indings. Thus, in total, we compared twelve 


zroups of face-to-face GDSS users with twelve groups of face-to-face non-GDSS users. 
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The Fiol-Woodbury study had three major findings and three minor findings. 
The major findings were: 


1. The distributed groups were more accurate in solving the case and, therefore, 
were considered to have produced higher quality decisions. 


tJ 


The face-to-face groups spent less time reading the case, but more time 
interacting, and thus more total time problem soiving, before reaching a 
consensus. 


Gd 


While both group types were satisiied with their individuai solutions, the 
distributed groups were somewhat iess satisfied with the group decisions than 
with their individual inputs. 


The minor findings were: 


— 
e 


There was no difference between the two group types as to satisfaction with the 
Selection cnitetia they Generateae 


2. No determination could de made as to which group type generated the most 
creative criteria or even which generated simply the most criteria. 

The face-to-face groups preferred to meet face-to-face. but the distributed 
Ssroups nad mo) preference for Setting: 


(3 


As seen in the above findings. the setting in which a decision 1s made can have an 
impact on the decision process. Some additional research has confirmed that the nature 
of the task can also nave an effect on the decision outcome [Refs. 30.42]. Since there 
has not been widespread availability of GDSSs. more research is needed to determine 
the types of problems that are appropriate to solve using a GDSS and the 
characteristics of that GDSS. We have addressed some of those areas in this paper 


already and our experiment deives into them further. 


B. PARTICIPANTS 


No study has been done that definitely suggests optimal group size for probiem 
solving with a GDSS. In general though, a group size of three is recommended for 
research [Ret. 30]. Fijol and Woodbury chose three as thetr group size in order to 
facilitate research comparison (some prior experiments on GDSS impact used groups 
of three [Rers. 31.43.44]), to aid individuai participation in the task vy ail group 
members. and because of the limited number of participants available [Ref. 26: p. 13]. 
We also used groups of three for the same reasons and to be consistent with the Fuol- 


Woodbury study. 


Ze 


Further, the population from which we derived our participants was as similar as 
possible to the Fijol-Woodbury population to ensure consistency. They were thus 
selected from the officer-student population of the Naval Postgraduate School (NPS), 
Monterey, CA. The majority of participants were students in the fifth quarter (out of 
six) of the Computer Svstems Management curriculum. In addition, because of our 
larger number of groups (eighteen groups versus twelve groups), we also included 
students in the third quarter of Computer Systems Management, along with the 
Command, Control. and Communications and the Telecommunications Systems 
Management curricula. Ail participants had had at least one formal management 
course at NPS and had taken part in several group projects. Since the participant 
population was very similar to that used by Fijol-Woodburv, we believe their selection 
had no impact on the outcome of the experiment. We also were aware of the 
improvement to be realized in the statistical significance of the study by comparing a 


\arger number of groups. 


As in the Fijoi- Woodbury study, the participants were a relatively homogenous 
group with similar management and educational backgrounds. Most formed their own 
groups for the experiment and knew each other well. They also had experience with 
group tasks from previous group project assignments at NPS. This is significant 
because it suggests that they had developed a relatively cooperative attitude, which 
would reflect a typical organizational decision making environment in which a similar 


culture and goals are shared. 


Although the participants’ experience at the Naval Postgraduate School was 
similar, their backgrounds prior to attending NPS, like the backgrounds cf the 
Narticipants in the Fijoi- Woodbury study, were diverse. However, one common factor 


that characterized them was at jeast 3-5 years of military management experience. 


C. GDSS SOFTWARE 


re 


fhe software selected for this study was Co-oP, a multi-cnteria GDSS. We 
selected Co-oP primarily because it was used in the Fijol-Woodbury study. They chose 
Co-oP because it was readily available, operational, and was suitable for use in the 
settings in which thev were working. The use of an existing software package had the 
advantage of not requiring them to create their own special purpose GDSS or trying to 


find one of the few GDSS packages that are commercially available and that would be 


suitable to their experiment. Additionally, being an academic product, Co-oP was 


relatively untested and its developer was interested in involving it in more research. 


Co-oP supported the group decision process in our empirical study by allowing 
the participants to generate selection criteria to be used in the case, to establish weights 
for the criteria, and to perform statistical analyses of the inputs to determine a final 
outcome. The software provided adequate support for both the face-to-face and 
distributed GDSS groups studied by Fiol-Woodbury, as well as our face-to-face 


groups. 


D. GROUP DECISION TASK 


Q 


Fijol and Woodbury selected the Energy International case [Ref. 45] as the group 
decision task to be performed. It was designed as a case study to examine group 
interaction within a group of five persons, in which each member was not given 
complete information on which to base a decision. Since it was not a goal of their 
study to measure information sharing and since they were working with a smaller 
group size, the case was modified so all members received the same, complete 


information (Appendix A). 


We also selected this case, as modified, for our study since it was considered by 
Fijcol and Woodbury to be valid for the GDSS decision making settings and would 
enable us to combine the data from each study. Thev found the case to be somewhat 
complex, in that it could not be solved immediately after the first reading. The nature 
of the task is to evaluate a list of candidates for the position of head plant manager in 
a Brazilian mining operation and make a selection based solely on the scenario 
presented in the case. the face validity was considered to be high because the case 
apparently described a realistic situation. The case is best solved bv determining 
criteria, Weighing them, and then using a step-by-step approach. These factors make 
the case supportabie by Co-oP. Since there were no conflicting facts within the case. 
its content validity was high. Also, the externai validity was likewise found to be ign 
because tne case beiongs to a general class of problems and does not portray a unique 
management decision making situation. Just how well this case truly fit the study ts 
discussed in detail in Chapter IV. After observing the experiment and reviewing the 


findings, we do not consider the case as applicable as did Fijol and Woodbury. 
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Our comparison of face-to-face GDSS and non-GDSS groups was designed to 
measure whether the complexity of the task allowed it to be efficiently solved with a 
GDSS. We believe that a suitable problem to be used with a GDSS is one that can be 
described as high task (highiv structured), low relationship (not involving group norms 
Or attitudes), and high complexity (having many different and interacting variables). 
While the Energy international Case could be descrived as moderately high task and 
‘ow relationsnip, the compiexity of the case may not be sufficient to be erficiently 


solvedeusing a GUSS. 


EB. HYPOTHESES, VARIABLES, AND QUESTIONNAIRES 


i. riypotheses 


We developed the following three hypotheses concerning the expecred effects 
of the decision outcome variables on the two groups: 


™ H,: fhe face-to-lace GDSS zroups will be more accurate in solving the case 
than the tace-io-face non-GDSS groups. 


Oe io ie tiie required to reach @ decision sexcluding the time to read the case. 
will be less in the face-to-face non-GDSS groups than in the face-to-face GDSS 
groups. 


® H+: There will be no substantial difference between the face-to-face non- 
GDSS groups and face-to-face GDSS groups in their satisfaction with their 
group decision. 


>. Variables 


Several additional issues were considered interesting, both to compare our 
results with those of the prior study and to support the model we have designed. [n 
ine mode! problem characteristics (task, relationship, and complexity) are considered to 
ecrermune tthe appropriateness of GDSS use and the recommended Uesign features of 
the GDSS. The additional issues we studied include: 
* What type of setting wil che groups most preter in solving this case? 


Wee cmmeno>s 51 ZOU .5 MmOSt likely co Generate the cases base line criteria 
(CmiemicgehesexDertS Jeimedmsamportant imsolvine the case)? 


m Vill there be asdifference im the aumber ofssupplemental (other than base line) 
criteria generated between the types of groups? 


* Are the groups content with their ability to discuss the criteria and interact with 
OU lemeneltio members? 


IES 


Three variables were measured using a questionnaire completed by each 


participant: 


ke 


{J 
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Decision task criteria - Did the case selected meet face validity, supportability, 
content validity, and external validity? 


Satisfaction factor - Were the participants satisfied with the criteria they 
generated? with their decision making process? with their solution? 


Setting preference - For this case, would the participants prefer to soive 1 with 
or without a computer? face-to-face or distributed group meetings? 


Three other variables were measured during the experiment as we cbserved 


and timed the proceedings: 


I. 


=) 


we 


Be 


Decision quatity - Did the group arrive at the experts’ solution? 
Input time - How long did the group spend actually soiving the case? 


Base line criteria - Did the group determine the minimal selection criteria? 


3. Questionnaires 


After each group of three finished solving the case and was told the correct 


solution, the questionnaires were completed. There were two questionnaires: one for 


the face-to-face non-GDSS groups (Appendix 8) and one for the face-to-face GDSS 


groups (Appendix C). The questionnaires mostly used a 5-point Likert scale, with steps 


ranging from “strongly disagree” to “strongly agree”, and concluded bv asking for 


general comments. Our questionnaires were patterned after the one used in the fijol- 


Woodbury study in order to verifv, and subsequently use, some of their data. Some 


NOMCetble Chances Were made. memaime. 


while they used one questionnaire for both groups (containing questions 
applicable to either one group or the other.so that no 70D gmcweredeaiiae 
questions), we choose to split the questionnaire among the two groups so that 
each participant saw and completed a questionnaire that was totaily 1.pplicabie 
Louthe pariicuian settinggie Ge sor clon 

the questions were all worded to permit a consistent, uniform. and famuliar scale 
for the participant’s responses throughout the questionnaire (ranging from 
“strongly disagree on thie leit to" Strongiymgree On the right), 


a. Yon-GoSS Questionnaire 


the “questions” for the non-GDSS groups were: 


Immediately after reading the case study, the correct candidate was intuitively 
obvious to me. 


[ would say chis case study could oe an example of an actual decision making 
situation in an organization. 


This case study seems realistic to me. 
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10. 
iL. 


I am verv satisfied with the number of criteria my group identified. 


If you assigned weights to your decision criteria for selecting a candidate, it 
helped in your decision making process. 


My group devised a very good solution to the case. 


I am very satisfied with the decision making process that my group underwent 
to develop a solution. 


I am verv satisfied with the final result derived from my group’s inputs. 
My group completely accepted my contributions to solving the problem. 
Everyone in my group had an equal chance to be heard. 


This case would be better solved in a setting in which all members met face-io- 
face but had a computer available to help them compile their results. 


This case would be better solved in a setting in which group members all had an 
input via a computer but did not meet face-to-face. 


b. GDSS Questionnaire 


The questionnaire for the GDSS groups was generally the same as that for 


the non-GDSS groups, but did contain some additional “questions” specifically related 


Pememen; ss, t-¢., ©o-oP. The questions for the GDSS groups were: 


Il. 


to 


Nw B® wv 


Immediately after reading the case study, the correct candidate was intuitively 
obvious to me. 


I would sav this case studv could be an example of an actual decision making 
situation in an organization. 


This case study seems realistic to me. 
This case lends itself well to support by Co-oP. 
I am very satisfied with the number of criteria my group identified. 


If vou assigned weights to your decision criteria for selecting a candidate, it 
feroed in your decision making process. 


Co-oP ts verv helpful in formaiizing my thoughts. 


My group devised a very good solution to the case. 


9. I am very satisfied with the decision making process that mv group underwent 


to develop a solution. 

[ am verv satisfied with the final result derived from my group’s inputs. 
My group compietely accepted my contributions to solving the proolem. 
Evervone in my group had an equal chance to be heard. 


This case would be better solved in a setting in which group members all had an 
input Via a computer but did not meet face-to-face. 


This case would be better solved without the use of a computer. 


jaf 


15. What factor, if any, would you say inhibited and/or encouraged your generation 
of inputs? 


16. Was Co-oP user friendly? 


17. In what kind of decision making situation would vou find Co-oP most useful? 


F. PROCESS 


The procedure followed in both the GDSS and non-GDSS groups was verv 
similar. The groups met at agreed upon times and locations. Both researchers were 
present during the entire session for both types of groups. One researcher read a brief 
set of standard directions that differed between the groups only tn that the GDSS 


groups received some instruction specific to using the GDSS (Appendix D). 


Individuals in both groups read the case and, when they were finished reading, 
proceeded to discuss it as a group. Both researchers acted as observers in the non- 
GDSS groups, whiie in the GDSS groups, one acted as an observer while the other 
acted as a chauffeur of the GDSS. The observer recorded the read time and discussion 
time, and answered any questions not directly related to solving the case. The observer 
also recorded the criteria generated by the group, their finai decision, and anything of 
interest in the decision process. The chauffeur was needed in the GDSS groups because 
il Was impractical to spend enough time to teach the participants to operate the GDSS 
on their own and also to be consistent with the Fiol-Woodbury study, as they used a 
chautfeur. In addition, the use of a chauffeur has been found valuable in both research 
and organizational settings [Refs. 29,46]. Before the GDSS groups began generating 
Input, some standard information, required by the software (e.g., group composition), 
was inputted so the grouns did not have to wait on that. It should be noted that the 
chauffeur only inputted group information that was agreed upon by all group members 


during the session. 


As stated above, the time required to read and absorb the case, as well as the 
time required to solve the case (decision time), was recorded for both types of groups. 
The read time was ihe time from when the case was handed out until at ieast two 
members of the group began discussing it. The decision time for the non-GDSS groups 
was from the end of the read time until a unanimous decision was reached. The 
decision time for the GDSS groups was from the end of the read time until the inputs 


were readv to be assembled and processed oy Co-oP. 
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Immediately after a group finished the case, they were shown the correct solution 
(Appendix E) and any questions were answered. A questionnaire was then completed 
by all group members and collected before they left. Since the two different settings 


were used, a slightly different questionnaire was used for each type of group. 
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IV. EMPIRICAL STUDY RESULTS AND DISCUSSION 


A. VALIDITY ANALYSIS OF DECISION TAS# 
The Fiol-Woodbury study found the Energy International case to be a valid 
group decision task. as determined oy Gallupe’s four essential characteristics - face 


validity, supportability, content validity, and external validity {Ref 30]. In their study 


Fijoi and Woodburv vreportedly established 


that each essential characteristic was present, was well represented, and satisfied 
ail requirements necessary to ensure the group decision task empioved during this 
experiment was valid. [Rem 26) 0725! 


We agree with most. but not all, or their findings in this area and thus will review each 


of these four characteristics. 


‘ 
, 


1. Face Validity 


if the task appears to be an example of an actual decision making situation 
and is realistic to the participants, then this characteristic is satisfied. [tems #2 and #3 
of both questionnaires addressed this simply: “[ would say this case study could be an 
example of an actual decision making situation in an organization” and “This case 
study seems realistic to me.” The summary of the 72 responses (our eighteen groups 
pius the applicabie six groups trom the Fijol-Woodbury study, three people per group) 
are ‘shown in Figure 4.i. As in the Fijcl-Woodburv study, a significant majority rated 
she ‘case both viable and realistic. However. it is now apparent that it is unclear exactiy 
what they were rating. For example, were they saying it ts likelv that an organizational 
group would meet. evaluate applicants, and make a personne! selection decision? Were 
Hew ens It 1S reali sticuue hire the olant’s General Manager solely based on the 
minimai personnel information given in the case? Were they saying senior management 
personnel are probably hired without a personal interview, without Knowing their sex, 
and without establishing actual pror work performance vice just experience? We 
submit that the basic minimum wage earner is screened and interviewed more 
rigorousiv than the applicants were in this case. So why did the participants rate the 


case generally nigh as regards to “realistic” and “an actual decision making situation”? 
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We believe that they viewed the general task of a group choosing among job applicants 
(as this case does) as realistic, but not that an actual real-life hiring would take place 
solely on the facts as presented in this case. If the sex of an applicant was deemed 
important. such information would normally be obtained and provided to the decision 


makers. 


Figure 4.1 Face Validity 


ot 


The decision makers would not have to guess at it, even if they could 


probably do so correctly. In fact, it is unlikely that a manager would be hired or even 


recommended without at least one interview. Selected written comments from the 


questionnaires support this view: 


could have had more details - as in real life interview summary 

a real decision of this nature would involve far more input of an intuitive nature 
not enough info, so not realistic 

the information would be less cryptic, in reality 


this case was fairly easy, and realistically could have been pared down by non- 
management staiY prior to submission to management 


managers would have access to full resumes, and more background information 


Too little information was supplied to make a good decision. I wouldnt hire 
anyone based on the information given. The group decision process was not a 
decision process so much as a process of elimination, until only one (candidate) 
was left. Based on the poor information, the “best” candidate may have been 
eliminated where a decision criteria mav have over shadowed his/her otherwise 
clearly superior capabilities. A waiver (of a criteria) may nave been called for. 


there was really no decision to be made - each candidate {but one) would be 
eliminated on the basis of the criteria 


if such a decision were actually being made, more info on the candidates 
would/should be available, e.g., personnel files 


trick question (sex)!! - there was really no decision making at all - just reading 
between the lines to Ceduce tiesacts 


the case should have been more specific (by stating) that of the listed schools, 
one was a women’s school 


woman issue in the 80's is a tough question to deal with - how realistic is it to 
assume women’s university graduate is actually female? 


the case itself was worded in a way to make it difficult to ascertain ail the 
important points 


the case would have been cleaner if the candidates were identified by male and 
female 


in a real life situation, the sex of an applicant would have been obvious at this 
final point of hiring - just as age was listed. so should have been sex, male or 
female, as this was crucial 16 the selecuiom wreecas 


The sheer volume of these related comments from our limited number of 


participants makes one pause over the ratings they gave to items #2 and #3 of our 


questionnaire. While they may have overall graded the case as realistic, many also 


made the extra effort to write out comments to the contrarv. 





As seen below, the Fijol-Woodbury study received similar comments, yet they 
placed their emphasis on the numerical aspects of their questionnaires and considered 
face validity to be satisfied. 


On the whole. some participants commented on the lack of information they, as 
Miangers, felt was Sssentiai in the selection process. They betieved personal 
interviews would have been important for determining the candidate's 
personality, general heaith. and sex: all elements not as obvious in the case itself. 

Lixewise. one participant expressed a desire to evaluate candidates along the 
lines of ‘adaptabilitv’ and ‘growth potenzual’.... Performance evaluations were 
aiso lacking and their omission cited as significant. [Ret. 26: pp. 25-29] 


The case has a valid premise (that of a group making a hiring decision), but 
the decision wouid not reaiistically be made for such an tmportant job with the 
minimal information provided. in lght of all these comments, our observations during 
the experiment. and our own Knowledge of personnel hiring practices. we would rate 


Mie Case s face validity “poor”. 


2. Supportability 


| 
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Figure 4.2 Co-oP Supportabiiity 


In considering supportabilitv, we looked at how well Co-oP, the GDSS 


selected. ient itself to this case. This matter was, of course, not addressed bv the twelve 


a5 


groups that did not use Co-oP, but was addressed by the six GDSS groups and by 
those in the Fijol-Woodbury study. Item #4 of the GDSS questionnaire dealt with this 
issue: “This case lends itself well to support by Co-oP.” The groups in the Fyol- 
Woodbury study overall rated supportability slightly above those groups in our study. 
This is due in part to their groups having been previously introduced to Co-oP and its 
underlying methodology in a course they had taken. As seen in Figure 4.2, the 
participants still were very split on this matter, with the majority feeling Co-oP just 
adequately supported this case. Our observations during the experiment bore this out. 


thus supportability is rated “fair”. 
5. Content Validity 


Neither the Fiyjol- Woodbury study nor ours contained any items with which to 
measure content validity: that is, the accuracy and consistency of the case’s task 
description. They relied on the fact that the case was published and proven and thus its 
content validity could be safely assumed as “exceilent”. Unfortunately this did not turn 
out to be a valid premise in the final analysis. The problem centers around the 
candidate Hule, who is meant to be rejected for supposedly being a woman candidate. 
To come to the conclusion that Hule is a woman, and, in fact, the only woman, one 
must first make several assumptions: 


@ that the “list” of four schools is ail inclusive (no one else awards a Degree of 
Mineralogy) 


¢ that no male student attends a women’s universitv 

° that no female student attends a non-women’s university 
These assumptions could hardlv have been sately made when the case was published in 
i972. and certainly are not valid in 1987. So while it may be highly probabiv that Hule 
Is a2 Woman, one cannot be sure. And since the solution to the case hinges on this 


unknown, the case’s content validity is aiso judged as “poor”. 
4, External Validity 


As with content yaliditv, no actual items with which to measure external 
validity were contained in our study. However. it can be sareiy stated that the task of 
choosing among job applicants is general in nature and does not represent one 
singuiarly unique situation. Additionally, the task would appear relevant to the 
participants in our studv, as many (in their role as military managers) would have been 
familiar with trving to match personnel to jobs. Thus the case’s external validity is 


rated “excellent”. 


5. Decision Task Validity Summary 


In summary, we rate the decision task criteria for the Energy International 
case as follows: 
1. face validity - poor 
2. supportability - fair 
3. content validity - poor 


4. external validity - excellent 


Considering the modifications made to the case for these studies. it is difficult 
Boedetermine Wwiat this case is testing. For example, is it testing the ability to solve 
logical word problems or perhaps the current attitude toward women in the managerial 
work force? If so. what does a GDSS, as used here, have to do with this? For all these 
reasons, we strongiv recommend this case not be used for further research along the 
lines of this or the Fijol-Woodbury studv. A more apvropriate case would be one 


fitting the model we provose in Chapter V. 


Nevertheless, prior to that conclusion, we used the case to replicate the Fiol- 
Woodbury study and found that there was some information to glean from the 


findings. 


B. RESEARCH RESULTS 


A discussion of the data we collected during the experimental studies follows. The 
analysis of research results is broken down by factors. Where relevant, rf statistic tests 
were used to test for the mean values and for a significant difference between mean 


values. A statistical anaiysis of these ¢ tests is given in Appendix F. 
|. Satisfaction Factor 


Four items on the questionnaires were devised to look at the satisfaction 
factor: 


1. [am very satisfied with the number of criteria my group identified (Figure 4.3). 


2. |! am very satistied with the decision making process that my group underwent 
to develop a solution (Figure 4.4). 


3. My group devised a very good solution to the case (Figures 4.5,4.6). 


4. J am very satisfied with the final result derived from my group’s inputs (Figures 
4,5,4.6). 
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The last two items above are essentially the same and were used as a small 
consistency check for the replies on the questionnaire. As seen in Figures 4.5 and 4.6, 
their responses to both items were overall consistent. Also readily apparent is the high 
level of overall solution satisfaction, even though, as we will see, only eleven of the 
twenty four groups matched the experts’ solution. Recall that the subjects compieted 
the questionnaires after they were given the solution. Such satisfaction, even when 
“wrong”, is perhaps attributable to several factors - their dissatisfaction with the case. 
the fact that their choice was oased on group consensus, or a general high degree of 
personal confidence, regardless of an “expert's” opinion. The Fyol-Woodbury study 


found a similarly high degree of satisfaction [Ref. 26: p. 34]. 


In ail the satisfaction measures, the level of satisfaction is slignrly less for the 
GDSS groups than it is tor the non-GDSS groups. The difference 1s too small to derive 
any significant findings from it, especially since both settings yielded firmly positive 
satisfaction levels. Reasons for the difference can reasonably be surmised: 


e The GDSS groups matched the experts’ solution less often (as addressed in a 
following section). 


e The GDSS groups were unfamiliar with the software used and had to rely on a 
chauifeur to interface with the computer. This probably made them feel less in 
charge of the task, while the non-GDSS groups ran the process totally. 


e The GDSS on several instances selected a candidate over whom the group 
expressed surprise anc displeasure. They sometimes felt it selected someone 
whom they definitely would not have chosen. This was due to the weights they 
had placed on certain criteria and their unfamiliarity with how Co-oP would 
mathematically processed their inputs. 


2. Setting Preference 


ihree ttems on the questionnaires were devised to check the participants 
opinions regarding solving this case with or without a GDSS, and in a [ace-to-face or 
distributed setting: 


1. This case would be better solved in a setting in which all members met face-to- 
face but had a computer available to help them compiie the resuits (Figure 4.7). 


2. This case would be better soived without the use of a computer (Figure 4.7). 


OF) 


This case wouid ve better soived in a setting in which group members all had an 
input via a computer but did not meet face-to-face (Figure 4.8). 


The first item was asked of the non-GDSS groups, the second of the GDSS groups. 
and the third of both groups. 
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Figure 4.5 Criteria Satisfaction 


As seen in Figure 4.7, the non-GDSS groups only slightly disagreed that the 


case would be better solved with a computer, with the most frequent response being 
“neutral”. Since most of the participants were in the Computer Systems Management 


curricula, they were familiar with the concepts and principals behind a GDSS and 
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Figure 4.4 Decision Making Process Satisfaction 


generally did not see one as necessary for this case. Their comments on the 


questionnaires spoke of the case being too simple for a GDSS (although most missed 


the solution) and of its not being a decision task as much as a logical process of 
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Figure 4.5 Final Solution Satisfaction - Non-GDSS groups 


elimination. Although in training for management in a high tech field, they were quite 


conient to deal with this case the old fashioned way, which was also the more 


successful method. 


Figure 4.7 also shows that those who used the GDSS, and thus a computer, 


were perfectly split in their opinion regarding its usefulness, again, in this case. As 
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Figure 4.6 Finai Solution Satisfaction - GDSS groups 


many subjects felt the case would be better solved without a computer as with a 


computer, and very few felt strongly one way or the other. 


The cultural factor plays a part in the opinions of both groups. While they 
may be more used to computers than the average individual, they are generally not 
used to computers aiding their decision processes and they are certainly not used to 


them making their decisions. People are more comfortable with what thev are familiar. 
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Figure 4.3 shows that doth the GDSS and non-GDSS groups firmly believed a 
iace-io-face setting wouid lend itself better to solving the case than a distributed 
setting. (In fact. the distrivuted groups in the Fijol-Woodbury study were more 
accurate in soiving this case. cnan the face-to-face groups.) Our groups saw an overall | 
advantage to a face-to-face setting, especially when one member would point out 
something another had overlooked in reading the case. Commonly held opinions were 
Strengthened as participants realized thev were being supported bv other group 


members. All the groups in this study actually met face-to-face, so they were surmising 
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Figure 4.8 Pace-to-Face vs Distributed 


‘vhat it would have been like to be in a distnbuted setting. In the Fiyjol-Woodburv 
study, the groups were evenly split between face-to-face and distributed settings. Their 
finding matches ours in that the face-to-face groups firmly preferred that setting; 
however, thev found that the distributed groups were only slightly in favor of a face-to- 


facesettinespxet. 26: pa scr 
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3. Decision Quality 


Of the non-GDSS groups, seven of the twelve groups correctly matched the 
experts’ choice. For the GDSS groups, only four of the twelve matched. Clearly, the 
GDSS (Co-oP) was not helpful in improving decision quality. Since that is a GDSS’s 
primary function, we have what might be called a serious malfunction. But why? Is the 


concept of a GDSS worthless? - no. Is Co-oP at fault? - not really. 


As previously discussed in this chapter. there is no decision to make in this 
case, provided the assumptions regarding sex are made. The case essentially sets up 
criteria that each candidate must meet, and failure to meet one criteria causes each 
candidate io be dropped from consideration, until only one candidate remains. In this 
case, there are not multiple, viable alternatives from which to decide. Therefore, a 
GDSS should not be used with this case. Co-oP, in particular, is best able to support 
ranking viable alternatives with multiple criteria. It is not set up to process an 
alternative that 1s rated so low in one criteria that it eliminates that alternative from 
further consideration. For example, suppose Co-oP were processing two applicants 
and a mandatory criteria was “age at least 35”, as in this case. Applicant A 1s rated 
“10” in all criteria except age, where he is rated “0” since he is under 35. Applicant B 1s 
old enough, but not such a shining star elsewhere, and is rated “6” in all criteria. Given 
a usual weighting of the criteria, Co-oP will chose Applicant A, even though he is 
ineligible, since it does not treat the “0” rating as “fatal” and remove Applicant A from 
further consideration. This type of processing resulted in at least three of our GDSS 
groups producing a Co-oP answer that they immediatelv rejected as not their choice. 
Given that Co-oP was apparently designed to handle only viable alternatives, one can 
argue chat only the viable alternatives should have been entered and processed. For 
this case, that wouid mean only one applicant would be entered; and one hardly needs 
a GDSS for only one alternative. Therefore, this was not an appropriate case to use for 
GDSS iesting, especially a GDSS with Co-oP’s features. 


This case 1s fairly high task, low relationship, and iow complexity. As per our 
model in Chapter V, a GDSS is not generally recommended for such a task. This case 
can hardly be used realistically to pass any firm judgements against using a GDSS as 
an aide to management decision making since Co-oP was not designed for this sort of 


task. 
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4. Input Time 


Figure 4.9 shows the input times in minutes for each of the 24 groups, broken 
down between the non-GDSS and GDSS groups. Input time was measured as the time 
from when the group members finished reading the case and began discussing it until 
they reached a final conclusion. I[t included the time spent actively solving the case as 
a group. For the non-GDSS groups, this time period ended as soon as they formed a 
consensus as to their final choice among the applicants. For the GDSS groups, it 
ended when they ranked the final applicant on the final criteria; Co-oP then produced 
their result in literaily microseconds of processing. As is seen in Figure 4.9, solving the 


case with Co-oP took nearly four times as long as not using it. 
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Figure 4.9 Input Time in Minutes 


Since the participants interfaced with the GDSS through a chauffeur, none of 
their time was spent learning how to use Co-oP. What slowed the GDSS users was the 


inherent ability of Co-oP to best handle only viable alternatives. The non-GDSS 


a4 


groups, for example, would see that an applicant was not an American citizen and 
immediately drop him from further consideration, not even trying to grade him on any 
other criteria. This type of action rapidly reduced their list of alternatives and thus 
greatly aided their timely arrival at a final solution. In contrast, the GDSS groups 
could not as readilv “drop” an alternative. Co-oP logically and methodically lead them 
through each criteria they generated and called on them to grade each applicant 
according to each criteria. The GDSS groups thus found themselves trying to come to 
a consensus on an applicant’s grading ("8 or 7?”) for a particular criteria when they 
knew they would not select that applicant due to his major failure in another criteria. 
They were spending time needlessiy debating over an otherwise ineligible applicant. A 
few of the groups picked up on this problem and began grading non-viable applicants 
as “0” in all criteria. This ensured those applicants would not be selected by Co-oP 
and decreased their input time. Were Co-oP to be regularly used bv the other groups, 
they would in time, no doubt, also discover this short cut. Further. as mentioned in the 
previous section. we believe they would soon learn to enter into the GDSS only the 


viable alternatives. 


Consistent with our model in Chapter V, the Energy International case 1s 
simplv too low in complexity to benefit from a GDSS. The task can be more quickly 


and more effectively solved without using a GDSS. 
5. Base Line Criteria 


By noting the criteria the groups used to evaluate the case’s applicants, we 
Were trving to determine if Co-oP’s formalized thought process would hinder or aid 
Criteria generation. Unfortunatelv, almost every group selected their base line criteria 
With an eye On the wformation given for each applicant. Thus, for exampie, the 
applicant’s marital status was not a criteria since the subjects saw they had no such 
information on the applicants. In lieu of sex as a criteria, some other choices were 
experience in foreign countries, type of management experience, and number of 
languages known. Most groups generated only enough criteria to enable them to 
arrive at their final choice. !t is certainly logical that if a selection will be made and 


onlv one aiternative remains, whv continue to seeX criteria with which to evaiuate it? 


The Energy International case had five base line criteria: 


Managerial experience required 


ro 


[Institute of Mineralogy Fellow required 


U2 


American citizen required 
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4. Portuguese ability desired 


5. Sex - male desired 


Of the non-GDSS groups, five of the twelve groups generated the base line 
criteria, as a minimum. For the GDSS groups, it was six of the twelve. All the groups 
that failed to generate the base line criteria missed only one criteria - sex. As 
mentioned above, this was mainly because most of the groups saw no wav to find an 
applicant’s sex and did not list critena for which they had no information. [t was 
apparent from their discussions as the groups worked with the case that almost everv 
group considered it vital that the applicant selected ve a male. Two of the GDSS 
groups that listed sex as a criteria failed to determine how to correctly differentiate 
among the applicants on the criteria. One group graded two applicants {neither Hule) 
as probable females and derived an incorrect solution. The other group graded all 


applicants equally on sex, vet determined the correct solution just the same. 
6. Group Interaction 


Two items on the questionnaires dealt with group interaction: 


1. My group completely accepted my contributions to solving the probiem 
(Figure 4.10). 


2. Everyone in my group had an equal chance to be heard (Figure 4.11). 


These variables were used in an attempt to see if the GDSS had anv impact 
on group interaction. Would it stifle the exchange of ideas among the group? Would 
there be more of a group leader evident in the non-GDSS groups? Or perhaps would a 


computer oriented individual dominate the GDSS groups? 


As seen in Figures 4.10 and 4.11, there was virtually no difference in group 
interaction among the two groups. Both felt very strongly that their contributions were 
completely accepted and felt even more strongly that everyone had an equal chance to 
be heard. 
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MY GROUP COMPLETELY ACCEPTED MY CONTRIBUTIONS 


Non-GDSS groups 
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rigure 4.10 Accepted My Contributions 
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EVERYONE IN GROUP HAD EQUAL CHANCE TO BE HEARD 


Non-GDSS groups 
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Figure 4.11 Equal Chance to beimeand 
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V. A MODEL FOR THE USE OF GDSS 


As we have noted in Chapters [II and [V, not ail problems are suitable for use 
with a GDSS. In our studv we found that the Energy International case !acked the 
Meeessam, COMmplcexiiy fo Se solved effectively with a GOSS. We selected the case 
primarily to replicate the detaris of the Fijol-Woodbury study. In this Chapter. we 
propose a model, based on probiem tvpe, that discusses the design features and settings 
most appropriately used with each problem tvpe. We also state that a certain level of 
complexity is required to use a GDSS effectively with a given probiem. The decision 
probiem that we used in our experimental study fails outside of the realm of our model 


and 1s not recommended for further use with a GDSS. 


A major problem of the GDSS designer is determining the factors that will make 
his or her system successful. A great deal of energy has been spent on studying the 
factors that contribute to the success of a GDSS. In spite of such research, the success 
of a GDSS is usually considered to be intangible, based on intuition rather than hard. 
fast measurement. -It is also important to consider that group decision making 
situations are fundamentally different than individual decision making situations and. 
as such, factors that contribute to the success of an IDSS mav not affect a GDSS in 


the same wav. No firm, definitive meaning can currently be ascribed to a “successful 
GPSS . 


Several specific factors have been discussed in the literature on wavs to improve 
ile ewecmveness of a GOSSwor mimimize sts Chancewof fatiure. Ceryeny and Clark have 
stated that the failure of systems 1s often the result of “our inabulitv to identfv the real 
MSer5eas stem, secure their commitment to the system and articulate their concerns 
Ine sealcemesvsten development {Rerm4725. 151}. itis important to note that for a 
System to succeed. it must de used frequently enough for users to gain a level of 
familiarity with the svstem [Ref. 42: p. 443]. Several authors have focused on the 
problem tvpe and the nature of group behavior [Ref. 33,34,42.48.49: pp. 17, 31, 444, 
Deo? Our proposes model. oresented later im this paper. also focuses¥on problem 
Vpe and the situations in which the GDSS is used. In addition, Sanders and Courtney 


list the following factors that have been cited in the literature as contributing to GDSS 
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effectiveness: user involvement in system development, consideration of user cognitive 
styles and individual differences, user attitudes and expectations, technical system 
quality, the impact of power redistribution, user motivation, top management support 
and training, accuracy and relevance of output, experience as a decision maker, and the 


relationship between cost effectiveness and GDSS success {Ref. 49: p. 77]. 


Dealing with the requirements discussed above 1s a major problem for the 
designer of a GDSS. At the present time, GDSSs are in their iniancy and it 1s doubttul 
that any existing system meets ail of the requirements. As more research 1s conducted 
and the field advances, it is unlikely that the requirements wil remain the same. 
Advances in technology may ailow designers to provide options that have not 


previously been considered. 


A. THE SUCHAN, BUI, AND DOLK CONTINGENCY MODEL OF GOSS USE 
1. Discussion of the Contingency Model of GDSS Use 


Modern managers are confronted with a wide range of problem types on a 
daily basis to which they must respond effectively. lore and more frequently 
problems encountered by managers require group interaction to determine an 
appropriate solution. A GDSS is a tool available to managers to assist them in more 
effectively solving problems that require group interaction. GDSS use may not be 
appropriate under all circumstances, however. Suchan, Bui and Dolk have proposed a 
model, based on problem type, that is designed to assist a user in determining the 
suitabiuty of GDSS use, see Figure 5.1. Many authors have cited problem type as a 
major issue in determining the effectiveness of GDSS use. and thererore. a model 


developed using this approach 1s reasonable. 


The two characteristics on which Suchan, Bui and Dolk have focused are task 
and relationship. High task problems, in the context of their model. are detined to be 
“.. . well-derined, technical and highly structured.” [Rer. 42: p. 444] Problems high in 
relationship are those in which there is *... an impact on the psychological domain of 
both workers and managers as weil as the “cultural” or internal makeup of the 
department, division or corporation” {Ref. 42: p. 444]. These two variabies are present 
to some degree in all problems and the model described by Suchan, Bui and Dolk is 


based on their interaction. 
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Figure 3.1 Suchan, Bui, Dolk’s Contingency Model 


2. Limitations of the Contingency Viodei 


The mode! discussed by Suchan, Bui and Dolk is limited because is does not 
consider some important variables related to problem tvpe and setting as major factors 
that impact GDSS effectiveness. It also considers only systems that are currently 
available. In the future, GDSS configurations could be available so that the use of 
some form of GDSS is practical with any problem type. DeSanctis and Gallupe have 
proposed a taxonomy of possible GDSS settings in which member proximity and group 
size are variables, see Figure 5.2, [Ref. 4: p. 598]. We propose that complexity is a 


significant variable affecting problem type that must be considered in a model designed 
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Figure 5.2. Taxonomy of Possible GDSS Settings 


to make recommendations for GDSS use. Problems high in complexity have a large 
number of interacting variables. We further propose that not all settings are suitable 
for use with all problem types. Under most circumstances problems that are high task 
or high complexity are suitable for use with a GDSS in any setting. High relationship 
problems, however, may involve hidden agendas and political motives that are more 
suitably handled in smaller groups and face-to-face. It is possible that high 
relauionship problems may be completely unsuitable for the use of a GDSS in any 


setting, depending on the types of relationships involved. 
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B. PROPOSED ELEMENTS OF A MODEL FOR GDSS USE 
1. Task and Relationship 


As in the Suchan, Bui and Dolk model we have selected task and relationship 
as maior variables determining problem type. The meanings are synonymous with the 
serms described above in their modei. High task problems are cold, business-ortented 
Cr economic-onented problems that do not involve human relationships. such as 
economic analyses. High relationship problems are those that atfect a groups power 
structure, the interpersonal reiationships in a group, or organizational norms. such as 


internal promotions. 
2. Compiexity 


We have chosen to add complexity to our modei because it nas been stated by 
several authors that decision support is best used as a means for managers to handle a 
compiex environment [Ref. 49.50: pp. 86. 41 Because of this, we feel that problems 
lacking a certain amount of complexity are not well suited for GDSS support. in fact. 
the GDSS may actuaily interfere with the solution of a problem if the group involves 
itself with the svstem and neglects the problem. This happened to some extent in our 
experimental study. We feel that the case that was selected was too simple for use with 
a GDSS because there were not enough interacting variables. Therefore. we do not 


recommend the case for use in further GDSS research. 


For the purpose of our model. we define complexity as a problem in which 
there are a large number of interacting variables. Characteristic of this problem type is 
a high degree of interaction and interrejation among the variabies and a low degree of 
Siructure to che  doint that che group is overwhelmed and requires some form of 
automation to nandle che highly complex problem. In a problem of this tvpe, it might 
even de difficuit co identify variables that have a valid impact on the solution. 
Generally speaking, problems that are highly complex lend themselves well to the use 
of decision aids oecause the various tools avaiable can assist bv providing memorv 
aids, some structure and operations that ailow the user to determine the impact of a 
decision on the various interacting variables. Highly compiex problems, in general. are 
best solved face-to-face, using the GDSS as an additional communications channel. 
The face-to-face interaction may be’ necessarv for clarity in view of the lack of structure 
and the larse aumber of interacting Variables. GDSS Suvport will be beneficiai 


oecause tools can oe made available to permit efficient decomposition of higniv 


oo 


complex decision problems and the memory aids provided by a GDSS can also be 


useful. 


It should be noted that the solution of low complexity problems is not 
necessarily immediately obvious. Yet they are problems that can be solved relativelv 
easily bv a group in a Very short period of time without the use of a decision aid. They 
mav be problems that management has deemed necessary to be soived by a group but 
that otherwise might be solved by an individual. They might also be problems that are 
solved by a group to improve acceptance of and commutment to the outcome. At the 
other eXtreme, high complexity problems are those in which there are a large number 
Oli variables and that will require a large amount of ume to soive. As mentioned 
abiove. this definition is somewhat subjective and the user should consider it a 


guideline. 


i 
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C.. DISCUSSION OF THE PROPOSED MODEL 

' The model we propose describes the interaction of the variabies task, 
relationship, and complexity as they relate to the use of a GDSS. We will describe 
each of the eight quadrants in the modei below. see Figure 5.5, and discuss the types of 
probiems that might fit within each quadrant. In addition, we wul discuss the optimal 
setting for coping with each type of decision and suggest any design features that may 


improve the quality of the decision. The descriptions are broad and somewhat 


sudjective and thus serve as guidelines for the optimal use or the GUSS. 


We will discuss each of the possible problem types and any suggested optimal 
settings below. We refer to suggested limitations because we realize that there mav be 
special circumstances that may prohibit the use of an optimai setting. for example. it 
might ve necessary to solve a high relationship decision in a2 computer mediated 
conference because it may be toOvexpensive to Cather tlesrco tiie dee ores neous ace 
We are not saying that using a GUSS will not work under the circumstances, oniy that 
a GUSS snould be used with caution and that the setting 1s less than optmal. 

We will also discuss speciai design recommendations. While it 1s important fora 
GDSS to have a comprehensive set of tools, we have mentioned the tools that we feel 


will be most useful in that setting. The incorporation of these tools in a GDSS 


designed to be used with a specific problem type should be beneficial. 
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Figure 5.3 Problem Type Model for GDSS Use 


1. Low Task, Low Complexity, High Relationship 


This type of problem is not generally recommended for use with a GDSS. 
Since the problem lacks a large number of interacting variables and since there is no 
precise method that can be used to solve it, the GDSS may be unnecessary. The use of 
a GDSS in a low task, high relationship environment might tmpede the decision 
process because it 1s an incorrect communications channei [Ref. 42: p. 445]. This tvpe 
of problem is probably a relatively small, personnel administrative problem that can be 
most effectively solved by a smail group meeting face-to-face. If a GDSS were used to 
support this tvpe of decision, useful design features might include a decision model 
including anonymity, a means of providing conflict resolution, and the ability to send 


private or public messages to other group members. 
2. Low Task, Low Complexity, Low Relationship 


This type of problem is not generally recommended to be supported by a face- 
to-face GDSS, however, a distriouted GDSS could be used for its solution. Because it 
lacks complexity and does not deal with human relationships, the GDSS can effectively 
serve as the primary communications channei. Although there is no specified 
methodology for solving this type of problem, the details can easily be inputted and 
retrieved from the GDSS. A face-to-face GDSS is not recommended because it is 
likely that the group will elaborate on ideas that lack the level of complexity to justify 
this expenditure of time. Research has shown that groups using a decision aid tend to 
use all the time they are permitted to discuss all alternatives [Ref. 44: p. 549], whether 
the problem warrants the expenditure of time or not. A further drawback to using a 
GDSS is that a system mav be used because users are interested in the technology of 
the system, even though the system is unsuitable for the problem that they are solving 
[Ref. 19: p. 102]. An example of this type of oroblem could ce a simple decision on the 
ordering of supplies. A useful design feature would be the inclusion of a means for 


listing alternatives, ranking them, and rating them and voting on them. 
5. Low Task, High Complenity, High Reiationship 


A GDSS should be used with care tn solving this type of problem. This tvpe 
of decision problem might be a negotiation or bargaining problem. It is a special class 
of problem and might warrant the use of a special purpose GDSS to deal with both the 
rational and social/emotional needs of the group. Since a high degree of relationship 1s 


involved, we recommend that the best setting for solving this problem is a small group, 
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meeting face-to-face. The use of a GDSS will serve as an additional communications 
channel and will provide tools needed to cope with the complexity of the problem while 
the face-to-face interaction of group members will ease the possible political tension 
and be useful in dealing with the hidden agendas that are sometimes present in high 
relationship decision problems. GDSS can be helpful in focusing attention on the main 
task and ailowing users to keen a clear picture of the negotiation process [Ref. 51: p. 
245i. Useful design considerations might include the use of anonymous or private 
vOling, a Sehavioral model that includes a method for contlict reduction. memory aids 
and a method to decompose the probiem to handle the high level of complexity. 
-. Low ‘ask, itigh Complexity, Low Reiationship 

AMG DSSmis recommended for use wsolving this type of decision task. This 
type of problem is characterized as being difficuit and requiring a iarge amount of time, 
e2tone thatcan oenelit irom the creativity of aygrounp. Tiesbest setting for this type 
of decision probiem is a smail zroup meeting face-to-face. A smail group is 
recommended over a large group because the formality necessitated by a large group 
might limit the participation of individual group members and thus reduce its 
creativity. A small group meeting face-to-face with a GDSS can best manage 
complexity and add structure to this xind of task. Examples of this type of problem 
include portfolio analysis and other decisions that have a large number of interacting 
yariabies and that are normaily based more on hunches than on a precise methodology. 
The use of decision models (such as Nominal Group Technique of the Delphi Method), 
memory aids, the ability to decompose the problem, list alternatives. and rate and rank 


them are recommended design options. 
3, igh Task, Low Compiexity, High Rciationship 
A GDSS could be used in solving this type of problem, however, it should be 


used carefully 


. 
# 


While this kind of problem is solved using a standard methodology, 
there are personnei issues that may inject political undertones into the scenario. An 
exampie might be selecting a candidate for a job based on standardized test scores. 
ihe recommended setting for use of a GDSS in solving this type of decision problem is 
face-to-face in a smail group, primarily because it is high relationship. Useful design 
features inciude the ability to send messages publicly or privately to group members, 
anonymous or public voting and input. and behavioral modeis that include conflict 


reduction tecnniques. 
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6. High Task, Low Complexity, Low Relationship 
This type of problem lends itself well to the use of distributed GDSS and 


moderately well to the use of a GDSS in a face-to-face setting. The problem can easily 
be handled by a large or a small group, but the use of a GDSS in a face-to-face setting 
may increase the decision time significantly. The reason for this is that group meetings 
require a certain amount of overhead time to be spent on information unreiated to the 
probiem, but a distributed group tmits sociai interaction. A distributed GDSS could 
improve communication for this type of problem oy standardizing communications 
[Ref. 19: p. 102]. This type of problem is usually standard and familiar. Special 
algorithms could be added to the GDSS to handle it. Another desirable design factor 


could include software that aids in ranking and rating criteria and voting. 
7. High Task, digh Compiexity, High Relationship 


The use of a GDSS in a face-to-face setting with a smail group is 
recommended for solving this type of problem. The decision might be one that has a 
many interacting variables, but includes some standard procedures for structuring the 
problem and deaiing with this complexity. It also affects personnel and, therefore. can 
invoive hidden agendas and political motivations. Examples of this tvpe of problem 
could be cost reduction, a decision about whether to close a department. maior 
reorganizations, or other strategic decisions. Design features of the GDSS should 
include decision and behavioral models (like Nominai Group Technique), a means of 
contlict reduction, the ability to decompose the problem to cope with its complexity, 
the ability to rank and rate criteria and vote, the use of anonymity, and the ability to 
send messages pubiiciy or privately to group members. These are typicaily very 
difficuit problems to contend with. but can be some of the most important to the 


organization. 
8. digh Task, High Compiexity, Low Relationship 


GDSS use in solving this tvpe of srobleny is hignty fecommended. Il is tne 
type of probiem that can be solved in a face-to-face or a distributed group and in a 
small or large group: aithougn cecause of the level of complexity, a smail group 1s 
slightly preferred. An example of this type of problem could be a decision on a 
complex technical issue, such as the purchase of hardware. This type of problem wiil 
best show the effectiveness of a GDSS because the GDSS wiil be able to efficiently 


deal with communications and nandle the large number of conflicting variables by 
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allowing problem decomposition. In addition, the GDSS will provide memory aids 
that will assist in handling the large number of variables and could provide a method of 


ranking and rating criteria and voting. 


D. SUMMARY OF THE MODEL 


The model described above is very general and will require a verv large body of 
research before it can be validated. Research on GDSSs has primanly involved 
graduate students as subjects. A reason for this is that there are few GDSSs in use in 
the private or government sectors to support a large scale empirical study. Stil. the 
need for support involving management is not diminished. There are at least four main 
problems encountered when studving graduate students. First, even when using 
graduate students with some management background, it is not possible to obtain a 
truely representative population. Second, it is difficult to secure graduate students in 
sufficient numbers to commit enough time to solve a nignly complex decision probiem. 
Third, it is difficult to test high relationship problems in a graduate school setting 
because the result of the group’s decision will never be felt by the group. Finally, the 
testing of large groups is difficult due to an inability to secure enough subjects whose 
schedules do not contlict. Research gaps in these areas can probably best be filled by a 
survey of organizations actually using a GDSS, once suitable systems are available and 


sufficiently used. 


Our experiment, described in Chapters III and IV, involved solving a case that 
can best be described as high to moderate task. low complexity, and low relationship. 
We consider the case selected for our experiment to be high to moderate task because, 
ii required generating criteria for decision making and groups could develop an 
algorithm io solve the case. The case can be further described as low relationship 
because the subjects did not know the candidates, were given very limited information 
about them. and wouid reel no lasting consequences of their decision. Low complexity 
was also a characteristic of this case because. although the solution was not intuitively 
obvicus. the authors of the case suggested oniv five criteria. In addition. there were 
onlv seven candidates. and it is clear from inspection that the case can easily be solved 


by a group in a short period of time. 


The GDSS design issue is an area that ts changing greatly. Advances in 


technology and research are fueling these changes and they are expected to continue 


oo 


for the foreseeable future. If the nature of organizations is truly changing, the need for 
an automatic group decision aid is evident. We expect that many of the tools and 
techniques that are considered state-of-the-art in today’s GDSS technology will be 
passe very quickly with the advent of expert systems, the use of “shells”, and other 
technical advances that will improve response times of systems. In the distant future 
we may see the “user-seductive” systems described by Vogel. Nunamaker, Applegate. 
and Konsynski [Ref. 53: p. 11]. When systems thanware more than meres ise: 
friendly” are available, GDSS technology will become almost a necessity in 


organizations. 
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VI. CONCLUSIONS 


a Pm wRIVIENTAL RESULIS 
1. Hypotheses 


[In Chapter [ff we introduced the following three hypotheses concerning the 
expected etfects of the decision outcome variables on the two groups: 
® ,: The face-to-face GDSS groups will be more accurate in solving the case 
than the face-to-face non-GDSS groups. 


Se ee eee cegtincG 10 ceacu a decision, excluding the time to read the case. 
wul be less in the face-to-face non-GDSS groups than in the face-to-face GDSS 
groups. 


me te There wrilSe mo substantial difference berweenihenface-to-tace non- 
GUSS groups and face-to-iace GDSS groups in their satistaction with their 
group decision. 


Lenseneview our findings on these hypotheses, as delineated in Chapter [V. 
a. Hy: Accuracy 


We saw that of the non-GDSS groups, seven of the tweive groups correctly 
Meee peamenewexpems choice: For the GDSS groups, it was only four of the twelve 
groups. The difference tn the two types of groups is significant and thus the hypothesis 
is clearly rejected. We are not saving GDSSs are not, in general. a usetul management 
Mee i200), Ve are saving that, tor mis case, a GDSS was a detriment to decision 
making. ihis is largely due to the case oeing characterized as fairly high task. low 
relationship, and low complexity, which is inappropriate for use with a GDSS. In 
Pamicuiar, the Compiexity of this case was too low to be used as a means of 
formulating a definitive judgment on GDSS usefulness. The case would also be more 
Memicieic oO Gls testing (particularly Co-oP) if it were more of an actual decision 


task (having viable alternatives) and not just an elimination task. 


Another possibile reason for the poorer performance bv the GUSS groups is 
GG wel erate ede on e-e Cs DSSstoumake the selection of an applicant, vice just assist 
tiem) With that selection. (DSSs. bv their very title, are decision suppor: systems» not 
decision making svstems.} {[n contrast, the non-GDSS groups were forced to come to a 


final decision on their own and this may have caused them to more fully examine the 
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case. The GDSS users were largely a group whose members had computer 
backgrounds, and who had been exposed to GDSS theory, had confidence in such 
theory, and thus had high expectations for the system - a system that most had not 
seen before and that certainly none had used extensively. They could not have fully 
appreciated how Co-oP would work their inputs, and were not cognizant of its 
imitations, its strengths. etc. These matters wouid be understood by someone who 
routinety used Co-oP and thus experienced users could be reasonably expected to 
oroduce better quality outcomes than our inexperienced users. The GDSS users were 
probably conrident they had provided the svstem enough bits and pieces of information 
to formulate the correct soiution: unfortunately they were wrong. Again. it 1s largely 
due to the nature ot this case (deliberateiy hiding key data - sex) and not to a GDSS 
deficiency. Regardless of all that. the basic validity of the case is still questionabie 
because an important personnei decision would probably not have been made without 
more information and because a GDSS would not be actually used to make the final 


selectuom, DUt merely ‘to lmid im what selection. 
b, H>: input Time 


As we cleariv saw, the input time (time spent actuaily solving, and not aiso 
reading, the case) for the GDSS groups was about rour times as long as it was for the 
non-GDSS groups (39 minutes versus 11 minutes). This also is mainly because the 
case is so low in complexity. [t simply does not need to be solved with computer 
assistance: and in fact 1s more quickly solved without a GDSS. Several of the 
applicants could be readily dropped from further consideration by the non-GDSS 
groups while the GDSS users did not have that option. it is expected that, with 
experience, the Cc-oP™sroups would leam how to use the Sotiyaueeeroree= icicnum 
(e.g., not rank non-viable alternatives). Of course. better still, would be to only enter 
the viabie alternatives, since they alone can be realistically rated and ranked. This ts 
how Co-oP best functions and this ‘vould become clear to the users as they became 
more experienced withthe systenil” Because*there Was only Umer 1am cmap plicant. tile 
rating and ranking features of the system were not used effectively. This again 


illustrates that Co-oP was not weil suited for the case. 


if a case was of sufficient complexity (numerous criteria and numerous 
viable aiternatives) to readily fit the computer environment (perfect memorv; large data 


manipulation capability), then it is certanlv conceivable that a group of managers. 
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experienced with a GDSS, might tmprove their decision making time by using their 
GDSS. Finding a sufficient number of volunteers with such experience and with the 


time to solve such a complex case would indeed be a formidable task. 
c. 3: Decision Satisfaction 


Here we saw that both the non-GDSS and GDSS groups were very 
satistied with their final group decision. their decision making process. and the criteria 
they generated. Althougn there was no significanr difference in this area between the 
two groups, the satisfaction level was siightly less for the GDSS groups in ail 


satisfaction variables. 
>. Variables 


Some additional issues were also researched, both to compare our results with 
those of the orior study and to support the mode! we designed: 
e What type of setting will the groups most prefer in solving this case? 


e Which tvpe of group ts most likely to generate the case’s base line criteria 
(criteria the experts defined as important in solving the case)? 


e Wiul there be a difference in the number of supplemental (other than base line) 
criteria generated between the types of groups? 


e Are the groups content with their abilitv to discuss the criteria and interact with 
other group members? 
ets review our findings from Chapter IV on these variables also. 


a. Setting 


The non-GDSS participants slightly preferred that setting, that is, preferred 
mer 1omusc a Computer for this case. ihe GSS users were perfectiv split in their 
Opinion on the computer's usefuiness - with most having no strong feelings one way or 
the other. Those who used the GDSS, however, tended to rate the computer's 
usefulness as slightly higner, even if they were very split in their views. So experience 
with Co-oP does seem to have a somewhat positive impact on its perceived usefulness, 
even for an inappropriate task. About ail we can truly conciude from this result is that 
users feel that a very low complexity problem is not suitable for GOSS use and, 
therefore, a GDSS should not de specifically designed for such a problem. That ts 
consistent with our model, in that a GDSS is not recommended for low complexity 


tasks. 
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There was a very strong preference for a face-to-face setting over a 
distributed setting, regardless of whether a GDSS was used or not, and even though 
none of our subjects actually experienced a distributed setting during our experiment. 
The Fijol-Woodbury study (which used both face-to-face and distributed) also found 
that subjects tested in a face-to-face setting preferred to meet face-io-face (their 
distributed groups were non-committal on the matter). This finding could be related to 
the positive effects of social interaction and the fact that people are stiil more familiar 
with face-to-face communications, even in light of fairly recent technological 


innovations in the field of distributed communications. 
b. Criteria 


We unsuccessfully attempted to determine if Co-oP’s formalized thought 
process would hinder or aid criteria generation. Since both the non-GDSS and GDSS 
groups selected their criteria based largely on the information provided on each 
applicant, and generally limited the criteria to only what was available and necessary to 
select a single applicant, no determination could be made regarding one group versus 
the other. If a group was able to cleverly step through the case information and 
withdraw the intentionally hidden gender data, then sex was selected as a criteria - the 
GDSS was not a factor in that. Had the groups generated their criteria before being 
allowed to view the candidate summary sheet, perhaps some finding could be 
determined. Yet thesGDSS couldenot be comsidered aslactom-evem (nememmeceause criteria 
generation is the first thing Co-oP requires {once the problem has been set up, as was 
done in advance for our groups), and thus is completed before Co-oP “does” anything. 
The effect of Co-oP’s formalized thought process is not apparent at this point bevond 
requiring completion of the criteria before moving on and beginning the evaluations. 
The non-GDSS groups were more able, if desired, to change their criteria in the midst 


of the evaluations. 
c. Interaction 


The GDSS had no measurable impact on group member interaction. Both 
the non-GUSS and GDSS groups felt very strongly that their contributions were 
completely accepted and felt even stronger that everyone had an equal chance to be 
heard. Members of both types of groups seemed equally active in the process, with no 
observed intimidation on anyone exposed to the GDSS, either by the GDSS itself or 


individuals perhaps more computer oriented. 
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3. Findings Summary 


e The Energy International case, being of high task, low relationship, and low 
complexity, in not recommended for GDSS testing, especially in view of its poor 
face and content validities. 


wee Cn tis Casend GiJSS Was a detriment 10 quality decision making. 
* For this case. a GDSS was a detriment to decision speed. 


* here was no substantiai difference between the face-to-face non-GUSS groups 
and face-to-face GDSS groups in their satisfaction with their group decision. 


®  Yhere was a very strong preference tor a face-to-face setting over a distnbuted 
Setting, regardlesssof whether a GDSS was used or not. 


* ‘Yhe GDSS had no measurable impact on the interaction among the zroup 
members. 


B. METHCDOLOGiCAL FINDINGS IN GDSS RESEARCH 


{(n order to make a GDSS useful to decision makers, researchers have 
concentrated on the characteristics of the problems to be solved and on design features 
that wiil oe beneficiai in the systems. Suchan. Bui. and Doik have proposed a model 
based on problem type [Ref. 42: p. 444]. DeSanctis and Gailupe propose that setting is 
aisO an important factor in determining the success of a GDSS [Ref. 4: p. 398]. 
Althougn these factors are important. the mistake of considering them separately 
should not be made. In the case of GDSS the whole is equal to more than the sum of 


the parts. 


In the model that we have proposed in Chapter V. we have considered problem 
wype, setting, and design characteristics. Although we recognize our modei is untested, 
Merce! teat it is, aebeasteam initial attempt io expiore the synersy that exists where 
ie owes concemed. {{ as expected that further research will be able to broaden the 
modei considerably ov adding more variables that impact on problem type and ov 
Mmieredsin©’ «wie Humber of factors that impact the GDSS. Thorough research in these 
areas and imvrovyed technoiogy will produce systems that wiil be of vital importance to 
tne largeiy information-reliant organizations of the future. Specifically, issues related 


tO communications. group dynamics, and conflict resoiution are of particuiar relevance. 
i. Group Communications Needs and the GDSS 


Oiverent 1a ie Glo = tecnmology iS “the need to provide efiective 


communications among group members, whether the GDSS is used face-to-face or ina 
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setting that is distributed in time or location. Communications can be considered the 
key to group problem resolution and group decision making. It has been abserved that 
decision makers use conversation as their primary means of making commitments 
[Ref. 17: p. 257]. Muintzberg has found that managers prefer using verbal media, such 
as telephone calls and meetings, to conduct their business [Ref. 11: p. 52]. The role of 
GDSS in the decision making process is, therefore, of great importance. Bui and Jarke. 
fRef. 2,52: pp. 614. i], Alter [Ref. 19? po. 971, and eine Retegso 05) ane ome 
authors that have recognized the necessity of providing communications support in a 
GOSs 


Using a GDSS in a distributed setting forces the! designer- ofga GSS to 
accommodate for the lack of face-to-face interaction that normally occurs during 
meetings. Bui and Jarke have proposed several communications characteristics that are 
desirabie in a distributed setting. Format transparent information exchange will permit 
users tO COMmunnicate through the GDSS without the requirement for special formats. 
A user should be given the option of providing information to all group members or 
privately to any member or members he or she selects. The communications 
component of the GDSS should not be rigid, but shouid allow communications to 
evoive depending on the nature of the task and the group. Bui and Jarke also discuss 


limiting communications as a means of reducing conilict [Ref. 32: pp. 3-5]. 
2. The eifect of Group Dynamics on GDSS Design 


Group dynamics play a role in GDSS design that is increasingly difficult to 
ignore. The nature of automated decision sunport should be to minimize group 
orocess losses (which includes certain overheads. such as distractions that divert the 
attention of the group trom the problem) and maximize group’ process gains (which 
includes the benefits attriouted to group interaction, such as consideration of more 
alternatives, etc.) due to group interaction [Ref. 33: p. 119]. Changing the nature of 
interpersonal relations is the sey tO increasing the ¢iiectivenesseol Goss anemic 
larger the change, the more noticeable the etfect on group productivity {Ref. =: p. 591]. 
GOSS designers must consider group dynamics to be of critical importance and should 
capitalize on the unique nature of group interactions to make their svstems more 


erfective. 


Factors that have an impact on group dynamics have been reported 


frequently, and it is necessary for GDSS designers to understand them. One factor, the 
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use Of anonymity in communications and voting, is often found in GDSS designs. 
While anonymity can increase creativity and reduce conformity, it can also heighten 
conflict because users become more blunt with each other [Ref 33: p. 12]. Group 
leadership is another factor that can be adversely affected by the use of a GDSS 
oecause equal participation by all members is encouraged and the leader’s control 1s 
limited {Ref. 16: p. $8]. A positive contribution of a GDSS is that it can redirect the 
focus of the group to the problem, if the group should become sidetracked (Ref. 33: p. 
17]. Size is a factor that can effect group dynamics by creating increasingly complex 
communication interfaces as the number of group members increases [Ref. 4: p. 591]. 
The nature of the decision making environment is thought to be a factor that may 


impact the reduired™enaracteristics of the GDSS. [Ref. 55: p. 9}. 


The setting (for example, face-to-face versus distributed in time or location) 
nas a significant impact on group dynamics. Lin suggests that non-verbal 
communication establishes the very nature of the group, and removing the group irom 
a setting in which they can work face-to-face or in which they can expect a prompt 
response to their input, will have a substantial impact on the group [Ref. 3: p. 2]. 
While problem solving in a distributed setting required less time, and thus it is implied 
that it was more efficient, the satisfaction of group members is not necessarily 
enhanced [Ref. 26: p. 41]. Member satisfaction 1s likely to be an important factor in 


the frequency of use ot a GDSS and should ce considered by designers. 


Introducing a computer to a group setting is a factor that has been 
demonstrated to de significant. The use of computerized conferencing may increase the 
number of daily communications between group members by a factor of between two 
and ten {Ref. 16: p. 89]. Graphics and CRT output have veen shown to produce better 
and faster decisions, requiring less data [Ref. 54: p. 921]. Designers must realize that 
computers can nave an eilect on the perceived quality of worklife which, if the effect 1s 
negative. can have a negative impact on productivity [Ref. 55: p. 1217]. Excessively 
complex systems may cause such low satisfaction with the svstem to effectively 
undermine its implementauon [Ref. 54: 5. 921}. Thus, “user-friendliness” and 


GOmeiemience ate necessary tO the Successful implementation of GDSSs. 


3. Conflict Resoiution in Group Decision Making with a GDSS 
The circumstances that lead to conflict in groups and a means to deal with 


conflict effectively are concerns of the GDSS designer. It must be noted that conflict ts 
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not always harmful to group processes but when it becomes distracting and disruptive, 
some form of conflict resolution is required. Anonymity in communications or the use 
of distributed settings can often increase the level of conflict in groups to the point 
where the conflict becomes an impediment to group process. The use of behavioral 
techniques such as those described oy Fogg and Levy [Ref. 56,57: pp. 332-358, 584] 
could be usefui in making GDSS decisions more efficient by reducing the level of 
disruptive conflict. COLAB is a meeting room equiped with a GDSS that is specially 
designed to study group decision making in a face-to-face setting. Conflict reduction 
Was seen bv CCOLAB’s designers as desirable in this setting and has already been 
incorporated into the system [Ref. 58: pp. 38-40]. A great deal of research 1s needed in 


the area of conflict resolution to improve the effectiveness of GDSS design. 


Negotiations are a special class of group problem involving multiple parties. 
each of whom has his or her own view of a given problem situation, and each of whom 
must come to an agreement. Since the negotiation process often involves politics and 
hidden agendas, there 1s a significant potential for destructive tension and a need for 
conflict resolution in systems designed to handle negotiations. Because it is a 
specialized task and has specific requirements, designing a special purpose GDSS for 
negotiation has been considered by some researchers to be effective. “GISss can oe 
designed to provide additional channels for communications but face-to-face 
interaction 1s Important in negotiation, so a distributed setting should not be used 
(Ref. 3: p. 4]. Critical tasks in negotiation involve the analysis and ranking of 
alternatives [Ref. 59: p. 470], as well as the use of conflict resolution and reduction 
techniques, both of which can be incorporated into a GDSS. An example system 
designed specifically for, and used successfully, in negotiation is Nego [Ref. 51: p. 254]. 
Nego assists users In coming to agreement ov focusing their attention on main points 
and by helping them to Keep a clear view of the negotiation process. However, further 
experimental research should be conducted to evaluate the effective use of these 


systems. 
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APPENDIX A 
ENERGY INTERNATIONAL CASE 


beereeire Greso: tie General Vianagers of Energy international (EJ), a voung, 
meGium-sized, growing corporation. The prime mission of EI is to locate and develop 


mineral claims (copper, uranium. cobalt. etc.). 


The companys business has grown very rapidly, especially in South America, 
wnere vour organization has been made welcome by the governments. [In a recent 
mesting the ooard of directors decided to deveiop a new property near Fortaleza, in 


northeastern Brazil. The operation will include both mining and mulling production. 


PSone viay (757. YOu have come [rom your respective plants in different 
iocations, This is the initial session of your annual meeting. Your first order of business 
today 1s to select a new Generai Manager for the Brazilan plant trom among the 


candidates on the attached list. 


Fortaleza, Brazil has a hot climate. one raiiroad. a scheduled airline. a favorable 
oalance of irade, a feudal attitude toward women, considerable unemployment, a low 


education level. a low literacy level. and a strongiv nationalistic regime. 


The government has ruled that the company must employ Brazilians in all posts 
except that of mamager. [t has also installed an official inspector, who will make a 
monthly report whicn must be countersigned by the General Mianager. None of the 
government inspectors and company’s emplovees or staff can read or write any 


sanguage but Portuguese. 


The Generai Vanager must have had at least three vears of experience as a 
manager in charge of a mining operation, oe a Fellow in the [nstitute of Mineralogy, 
and 9e an American citizen. 


retlowship in the [nstitute of Mineratogy can be obtained bv those over $5 vears 


of age who have otherwise quaiified for General Viembership in the Institute. To 
quaufy ror General Membership, a candidate must nave a degree in mineralogy with a 


passing grade in paleontology and seismology. 
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There are a number of schools offering degrees in mineralogy. The smaller 
universities require three, the larger four, special subjects as part of their graduation 
requirements. The smallest 1s a women’s university. The largest university, the New 
York School of Mines, requires geology, paleontology, geophysics. and seismology for 
graduation. The New Mexico Institute of Earth Sciences requires geology, seismology, 
and paleontology, in addition to the usual courses. The Massachusetts Institute of 
Sciences requires zeology, seismology, oceanography, and paleontology. St. Francis 
University, which is not the smallest school, requires paleontology, geophysics, and 


oceanography. 


Using the above information and the attached candidate summary sheet. vou are 
to develop vour own criteria and based on them choose one best candidate for the 


position. 
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Name: 
Age: 
Passport: 
Education: 


Languages: 


EiaplOvment: 


EY ame: 
Exc: 
Passport: 
Education: 


Languages: 


Employment: 


Name: 
Age: 
Passpert: 
Education: 


Languages: 


Employment: 


CANDIDATE SUMMARY SHEET 


R. Ulin 

315) 

L3452 - USA 

New York Schooi of Mines - degree in mineralogy - 1972 
English, French. German, Portuguese 

Research Assistant, New York School of Vlines - 1973-75 
Lecturer, Mineralogy, University of Bonn - 1975-85 
Manager, Utah Copper Mining Co. Plant - 1985 to date 


Seimule 
42 
4567 - USA 
New Mexico Inst. of Earth Sciences - degree in mineralogy - 1970 
English, French, Portuguese 
Management Trainee, Uranium Unlimited - 1970-72 
Geology Officer, Anaconda Copper Co., Montanta area - 1973-80 
Manager, Imsh Mining Co., Ltd. - 1980 to date 


T. Gadoiin 
4] 
239 - oA 


New York School of Mines - degree in mineralogy - 1970 
cngiisn, Portuguese 

Management trainee, United Kingdom Mining Board - 1970-72 
Assistant Manager, N.D.B. Cheshire Plant - 1973-81 

Manager, Idaho Cobalt Minerals - 1981 to date 


TI 


Name: 
Age: 
Passport: 
Education: 


Languages: 


Employment: 


Name: 
owe 
Passport: 
Education: 


Languages: 


Employment: 


Name: 
Age: 
Passport: 
Education: 


Languages: 


Employment: 


Name: 
oe: 
Passport: 


Education: 


Languages: 


Employment: 


Ue sarmnar 
33 
H6259 - USA 


Massachusetts Inst. of Sciences - degree in mineralogy- 1974 
English, German, Swahili, Portuguese 
Jr. Engineer, W. Virginia Mining Research Station - 1974-83 


General Manager, Liberian State Mining Plant - 1983 to date 


Vemieie 

36 

K62371 - USA 

New York School of Mines - degree in mineralogy - 1971 

English, French. Welsh, Pekingese 

jr. Development Mineralogist, Ontario Mining Constr. Ltd. - 1971-74 
Assistant Chief Mineralogy Officer, Canadian Dev. Board - 1975-78 
Plant Manager, Welsh Mining Co.,Ltd. - 1979 to date 


W. Noddy 

43 

H63241 - USA 

St. Francis University - degree in mineralogy - 1968 

English, Portuguese, Russian, Arabic 

Assistant Manager, Societe Debunquant D’Algerie - 1968-72 


Manager, Kemchatka Mining Co. - 1973 to date 


X. Lanta 

36 

Ql23YB - Canada 

University of Quebec - diploma in English - 1970 
Massachusetts Inst. of Sciences - degree in mineralogy - 1973 
Spanish, English, Portuguese 

Tech. Officer, Sardinia Mining Corp. - 1975-83 

Manager, Moab Valley Mining Plant - 1983 to date 
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APPENDIX B 
QUESTIONNAIRE FOR NON-GDSS GROUPS 


the following questionnaire was completed by the non-GOSS group members 
immediately after they finished solving the case. Below the scaie for each question is a 
circled number that represents the number of individuals who selected that response to 
the question. The responses to these questionnaires are the source of raw data that we 


used to derive our statistical analyses. 


QUESTIONNAIRE : NON-GDSS 


(THE CIRCLED NUMBERS INDICATE THE RAW DATA COLLECTED 

IN OUR STUDY) 
PLEASE RESPOND TO THE FOLLOWING STATEMENTS BY CIRCLING 
THE RESPONSE THAT BEST MATCHES YOUR REEEINGS 1@./AR ew. = 
STATEMENT. THANK YCU FOR YOUR HELP. 


1. IMMEDIATELY AFTER READING THE CASE STUDY, THE CORRECT 
CANDIDATE WAS INTUITIVELY OBVIOUS TO ME. 


1 2 3 ~ 5 
[--eee ese [esos ene [--2e- 2222 [eee sse-e- 
STRONGLY DISAGRE= NEUTRAL AGHRE= STRONGLY 

DISAGREE AGREE 


©) © QO © 


2. | WOULD SAY THIS CASE STUDY COULD BE AN EXAMPLE OF A 
ACTUAL DECISION MAKING SITUATION IN AN ORGANIZATION. 


1 2 2 - 5 

[== 22 2-2--- ae re [=n 222-22 | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE AGREE 


®m © © @ @ 


3. THIS CASE STUDY SEEMS REALISTIC TO ME. 


1 2 e 4 é 

[=e 2-22 ed oe [es2ee eee : 
STRONGLY DISAGREE NEUTRAL AGREES STRONGLY 
DISAGREE AGREE 


© ©) O ® © 
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Ht. SELECTION CRITERIA 


4. | AM VERY SATISFIED WITH THE NUMBER OF CRITERIA MY GROUP 


IDENTIFIED. 
1 @ 3 - S) 
J--- 22222 oe Joeeseesoe- [ese 220-- 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE AGREE 


@ © ©) 


5. IF YOU ASSIGNED WEIGHTS TO YOUR DECISION CRITERIA FOR 
SELECTING A CANDIDATE, IT HELPED IN YOUR DECISION MAKING 
PROCESS. 


1 2 3 - 3 

[ano -- 22 [---2------ [ano eoe eee [== --22-- | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE 


QO © © 


i. ~“HESULTS 


6. MY GROUP DEVISED A VERY GOOD SOLUTION TO THE CASE. 


1 2 3 ~ 3 

J=-----7--- [nec ee eos neo ee eee Jez-2- 22s | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE 


(pe 


7. 1AM VERY SATISFIED WITH THE DECISION MAKING PROCESS THAT 
MY GROUP UNDERWENT TO DEVELOP A SOLUTION. 


| Z 3 a S 
[ee ees eee [eececeeee- [=e 2-222e- [eee 2c eee | 
STRONGLY DISAGREE NEUTRAL AGREE adi 
DISAGREE 


®© @) © = @ 


8. 1AM VERY SATISFIED WITH THE FINAL RESULT DERIVED FROM 
MY GROUP SiN Pais: 


1 2 3 -- S 
cee a aaa aeee = ier i 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE AGREE 


Q © ® 


9. MY GROUP COMPLETELY ACCEPTED MY CONTRIBUTIONS TO SOLVING 
Ter ROBE VE 


1 2 3 4 2 

Joneo rece entree [azo ees neo Jazzs-oo-- 
STRONGLY DISAGREE NEUTRAL AGREE a 
DISAGREE AGREE 


@ © © & 
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10. EVERYONE IN MY GROUP HAD AN EQUAL CHANCE TO BE HEARD. 


1 Z 3 - S 
[eee ee esse [ass 2222-2- [-eeeec eee Jesse eee- | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 

DISAGREE AGREE 


® © © @ @ 


i tS CASeV@bLD BE Semen SCLVED INA Sei TING IN WHICH 
ALL MEMBERS MET FACE TO FACE BUT HAD A COMPUTER 
Pelee] fOmere FIEMPCOMPILE THEIR RESULTS. 


1 2 3 4 5 
aso igor Bae ae = a8 | 
STRONGLY DISAGREE = NEUTRAL AGREE STRONGLY 

DISAGREE AGREE 


©) @) © QO © 


12. THIS CASE WCULD BE BETTER SOLVED IN A SETTING IN WHICH 
GROUP MEMBERS ALL HAD AN INPUT VIA A COMPUTER BUT DID 
NOT MEE? FACE-TO-FACE. 


1 2 S A 5 
oe Tt ng SE | ee eae ! 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGRE= AGREE 
ak | 
(0) (0) @) (13) 
CCMMENTS: 


fea 


APPENDIX C 
QUESTIONNAIRE FOR GDSS GROUPS 


The following questionnaire was completed bv the GDSS group members 
immediately after they finished solving the case. Below the scale for each question is a 
circled number that represents the number of individuals who selected that response io 
the question. Tne responses to these questionnaires are the source oi raw data that we 


used to derive our statistical analyses. 
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QUESTIONNAIRE : GDSS 


(THE CIRCLED NUMBERS INDICATE THE RAW DATA COLLECTED 
IN OUR STUDY) 


PLEASE RESPOND TO THE FOLLOWING STATEMENTS BY CIRCLING 
THE RESPONSE THAT BEST MATCHES YOUR FEELINGS TOWARD THE 
STATEMENT. THANK YOU FOR YOUR HELP. 


l. CASE 


1. IMMEDIATELY AFTER READING THE CASe STUDY, THE 
CORRECT CANDIDATE WAS INTUITIVELY OBVIOUS TO ME. 


1 2 3 - 5 
[--e22s 2 J-eee esses [--eeees ee: [eee eeoee- | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 

DISAGREE 


em © © © © 


2. | WOULD SAY THIS CASE STUDY COULD BE AN EXAMPLE 
OF AN ACTUAL DECISION MAKING SITUATION IN AN 


ORGANIZATION. 
1 2 3 a 3, 
[oes eec eee [eeoeee eee [eee es eee [ose eeeee- | 
STRONGLY DISAGRE= NEUTRAL AGREE STRONGLY 
DISAGRE= AGREE 


@ @) @ © 


Sig CASE ONOe See aeALiSlIC TOME. 


1 2 3 ~ ° 

[ens eee eee J---eeee ee J--- esse Jens eeeoe- | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE AGREE 


© Oo ®G © 


ie) 


4. THIS CASE LENDS ITSELF WELL TO SUPPORT BY CO-OP. 


1 2 3 4 S 
Jonaeee seo [J-e-2eee-e- |J---22-2--- J--- 222 2-- | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 

DISAGREE AGREE 


QQ © @ ©) 
HW. SELECTION CRITERIA 


5. | AM VERY SATISFIED WITH THE NUMBER OF CRITERIA MY GROUP 


IDENTIFIED. 
1 2 2 4 5 
Gee oreo: oe aa 
STRONGLY 
STRONGLY DISAGREE NEUTRAL AGREE AGREE 
DISAGREE 


QO © @ Q ©® 


6. IF YOU ASSIGNED WEIGHTS TO YOUR DECISION CRITERIA FOR 
SELECTING A CANDIDATE, IT HELPED IN YOUR DECISION MAKING 


PROCESS 
1 2 3 - 3 
ee beseeeeeen peceeeeees peneteeeny 
STRONGLY STRONGLY 
DISACHES DISAGREE NEUTRAL AGREE AGREE 


OQ © © Q © 


7. CO-OP IS VERY HELPFUL IN FORMALIZING MY THOUGTRS. 


1 2 3 } 5 
eee eeceee|eceee esse eeeeeetael aeeaeaaeed 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE AGREE 


OQ © @ QO ® 
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ll. RESULTS 
8. MY GROUP DEVISED A VERY GOOD SOLUTION TO THE CASE. 


1 2 2 4 S) 

[ees eese-e- J-es2es2-e- [aso 2-s2-2- [aeeeseeee | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE AGRE= 


® © © © @ 


9. 1AM VERY SATISFIED WITH THE DECISION MAKING PROCESS THAT 
MY GRCUP UNDERWENT TO DEVELOP A SOLUTION. 


: 2 3 - 2 

re oe oe [oes esee- | 
STRONGLY DISAGRE= NEUTRAL AGREE STRONGLY 
PISAGREES pGee= 


@) @ ©) @) 


10. |AM VERY SATISFIED WITH THE FINAL RESULT DERIVED FROM 
MY GROUP'S INPUTS. 


1 ; ° - 5 

Peeper eee Deere ae | 
STRONGLY Sy ei el AGRES STRONGLY 
DISAGRE= AGREE 


© © © ® @ 


11. MY GROUP COMPLETELY ACCEPTED MY CONTRIBUTIONS TO SOLVING 
Gals @is)\: oN 


| Z 3 4 3 

| |- 2-27-27) oo Sk Voss oes l 
STRONGLY DISAGREE NEUTRAL AGREE STRCNGLY 
DISAGREE AGREE 


® © © ®@ & 
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12. EVERYONE IN MY GROUP HAD AN EQUAL CHANCE TO BE HEARD. 


1 2 3 4 5 

Jaeo2eee ee Jesse eee Joeeo eee oe | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE 


@) ©) © QO ®& 
13. THIS CAS& WOULD BE BETTER SOLVED ies SET TING IN WriCea 


GROUP MEMBERS ALL HAD AN INPUT VIA A COMPUTER BUT DID 
NOT MEET FACE-TO-FACE. 


1 2 2 - = 

oe [esos ese [eeeeeee ee [eee ec eee | 
STRONGLY DISAGREE NEUTRAL AGREE STRONGLY 
DISAGRES= : 


AGRE= 


© ®) ©) QO @ 


*k 14. THIS CASE WOULD BE BETTER SOLVED WITHO 


1 Tee USE Cae 
COMPUTER. 
| 2 3 4 5 
Seer peered Pere eee eerie ereeerert 
aie, DISAGREE NEUTRAL AGREE STRONGLY 
DISAGREE 


AGREE 
@ S @ QO © 


+ This question was not asked by Fijol and Woodbury, therefore the raw data 
shows tewer responses. 


IV. QVERALL IMPRESSION 
15. WHAT FACTOR, IF ANY, WOULD YOU SAY INHIBITED AND/OR 
ENCOURAGED YOUR GENERATION CF INPUTS? 
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16. WAS CO-OP USER FRIENDLY? 


17. INWHAT KIND OF DECISION MAKING SITUATION WOULD YOU 


FIND CO-OP MOST USEFUL? 


COMMENTS: 
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APPENDIX D 
PARTICIPANT INSTRUCTIONS 


DIRECTIONS FOR NON-GDSS GROUPS 


1. Each member of your group will be receiving an Energy International Case Data 
Sheet and Candidate Summarv Sheet. The purpose of our experiment is to test out a 
Group Decision Support Svstem called Co-oP. We are specifically comparing the 
impact of Co-oP dy iooking at two decision making settings. In one setting a group 
meets face-to-face with a GDSS, and in the other setting a group meets face-to-face 
without a GDSS. Your group will be meeting without the GDSS. 


2. You wiil ve asked to read the data and summary sheets and, when all members of 
your group are finished reading, vou will discuss the case within your group and trv to 
reach a consensus as to which candidate best meets the case requirements. You may 
keep the data and summary sheets and refer to them during the discussion. You may 
also take notes, but please don’t write on the case or summary sheets. 


3. Your group will be timed from the time you begin reading until the time all 
members have finished reading, and from the time you begin to discuss the case until 
you reach a final consensus. There are, however, no time limitations or goals. You are 
encouraged to take your time. read the case carefuily and then discuss it to ail 
members’ satisfaction. Your goal is not to finish quickly, but to arrive at a quality 
decision, based solely on the information given. 


4. Both of us will be present during the time you're reading and solving the case in 
order to answer anv procedurai questions. Please note, there is one best answer to the 
case, per the “experts”. In order to keep from biasing the experiment, we cant answer 
non-procedural questions once vou begin discussing the case. 


5. When you have completed the case. we will briefly discuss the best solution and vou 
will be asked to Gl out @ Questionnaire and returm it before you leaves ine 
questionnaire ends with a place for comments; any that you have will be helpful. and 
thus are welcome. 


6. Thank-you very much for your time and effort. 


7. When you are finished reading you may begin discussing the case. 
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DIRECTIONS FOR GDSS GROUPS 


1. Each member of your group will be receiving an Energy International Case Data 
Sheet and Candidate Summary Sheet. The purpose of our experiment is to test out a 
Group Decision Support System called Co-oP. We are specifically comparing the 
impact of Co-oP by looking at two decision making settings. In one setting a group 
meets face-to-face with a GDSS, and in the other setting a group meets face-to-fac 
without a GDSS. Your group will be meeting with the GDSS. 


im 


2. You will be asked to read the data and summary sheets and, when all members of 
your group are finished reading, you will discuss the case within your group and try to 
reach 2 consensus as to which candidate vest meets the case requirements. You may 
keep the data and summary sheets and refer to them during the discussion. You may 
aiso take notes, but piease don't write on the case or summary sheets. 


5. Your group will be timed from the time vou begin reading until the time ail 
members have finished reading, and from the time you vegin to discuss the case until 
vou reach a finai consensus. ihere are, however, no time limitations or goals. You are 
encourased tO take vour time. read the case carefully and then discuss it to all 
members satisfaction. Your goal is not to finish quickly, but to arrive at a quality 
decision. dDased sojelv on the information given. 


3 


+. Both of us will be cresent during the time you're reading and solving the case in 
Order tO answer anv orocedural questions. Please note, there is one best answer to the 
Seeemecmtnce expems | In order 10 Keep trom biasing the experiment, we can t answer 
non-procedural questions once vou begin discussing the case. 


3. We will act as vour interface with the computer. What you have to determine (as a 
group) is the cnteria vou will use to select the individual. assign weights to each criteria 
(equal ‘veights are acceptable}, and then rank each individual according to each 
criteria. Co-oP will then number crunch and produce the selection based on vour 
Sigitseee: OC example. “vO Crilena meuchmepe celer amd height, weighted 8 and 6 
peSpectivety (On # ) to 10 scaie}. Sub-criteria are permitted, if desired. For example, 
uncer color might be hue and brightness. 


r 


6. When vou have completed the case. we wiil briefly discuss the best solution and vou 
wil oe @skead <o will out a questionnaire and return it before you leave. The 
questionnaire ends with a piace for comments: any that vou have wiil be neiprul. and 
thus are welcome. 


7. thank-you very much for your time and erfort. 


3S. When you are finished reading you may begin discussing the case. 
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APPENDIX E 
CASE SOLUTION 


The foilowing is the solution agreed upon by experts. Before | read the solution 
{ want to make it clear that all groups are using the same case study. Because ot this, 


[ ask that you do not discuss the case outside this session. 


The criteria that the experts used to rate the candidates were as follows: 
» Languages spoken (must speak Portuguese) 
* ‘Years of mine management experience (at ieast 3) 
* Nationality (US Citizen) 


» Sex (Because of the feudal attitude toward women, a woman should not be 
considered.) 


» Fellowship in the Institute of Mineralogy 
[llin - has only two years of mine management experience. 


Hule - attended New Mexico Institute of Earth Sciences (NMIES) which is one 
of the two smaller schools since they offer*only three™@speciai™sulsjeciss > tamer eines 
not the smallest, so NMIES must be. This means tt is a women’s universitv and Hule 1s 


thus a woman. 
Gadolin - meets all the above criteria. 
Samar - at 35, is too young to be a Feilow. 
Lute - does not know Portugese: 


Noddy - went to St. Francis which does not offer seismology; qualification for 


General Membership is thus not met. which means neither is qualification for Feilow. 
Lanta - is not an American citizen. 


Since each candidate. except Gadotlin, is disqualified for not meeting at ieast one 


oi the criteria, Gadolin is the best choice. 
Any questions? 


lease turn in all materiais and we ask that you take a few moments to fill out a 


questionnaire oerore you leave. 
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APPENDIX F 
ADDITIONAL STATISTICAL ANALYSIS 


Where relevant. ¢ statistic tests were used to test the mean values and to test for 
a significant difference between mean values. As in the Fijol-Woodbury study, a 0.05 
level of significance for each test was used to decide whether or not the null hypothesis 


Hy should oe rejected. 


ie CORP OSRBSES 


We developed the following three hypotheses concerning the expected effects of 
the decision outcome variables on the two groups: 


¢ H,: The face-to-tace GDSS groups wiil be more accurate in solving the case 
than the face-to-face non-GDSS groups. 


Oeil oe ie tine required s@ reach a decision, excluding the time to read the case, 
will oe less in the face-to-face non-GDSS groups than in the face-to-face GDSS 
groups. 


¢ H,3: There will be no substantial difference between the face-to-face non- 
GDSS groups and face-to-face GDSS groups in their satisfaction with their 
group decision. 

Tae ¢ test is not applicable to H, since there is no mean for decision quality - 
either a group solved the case correctly or they did not. The ¢ tests for Hy and H, 
follow. 

1. H,: Input Time 

The nuil hypothesis 1s: 
¢ Hp: Tnere will oe no significant difference between the face-to-face non-GDSS 


groups and face-to-face GDSS groups in their time required to reach a decision. 


The alternative hypothesis is: 


Y 


, : There wil oe a significant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in their time required to reach a decision. 


As seen in Figure F.1, the difference is significant and Hy is rejected. The 
non-GDSS groups had an average input time of almost one fourth that of the GDSS 


groups. 
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Non=-GDSS groups 





GDSS groups 


| 

: aC 36.0 45.0 54.0 63.0 
| N MEAN MEDIAN  TRMEAN STDEV SEMEAN 
| 12 38.75 38.50 S770 10. 18 94 
| 

| 2h DE i Significant Difference? 
| =3. 91 14.4 =2. 409 ve 


Thus reject Hp. 





Figure F.l Input lime im siamese tese 


DB) H> : Satisfaction Factor 


THe nulls pothesicas: 
¢ Hp: There will be no significant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in their satisfaction. 
The alternative hypothesis is: 
* H,: There wiil oe a significant difference between the face-to-face non-GDSS 
groups and tace-io-iace GDSS groups in their satisfaction. 
There were four variables surveved for satisfaction: 


I. mumber of criteria identified 


tN 


decision making process 
fim apes 


4. very good solution devised 
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Of these four variables, the last two are essentially the same and were used as 


a consistency check for the responses to the questionnaires. 


Figures F.2, F.3, and F.4 show Hg being rejected, while Figure F.5 has Ho 
being accepted. The resuits are mixed. but all the mean pairs are fairly close upon 
inspection. From the ¢ tests, we find that there is a statistically significant difference 
between the two types of zrouns in satistaction level, with the GDSS group being less 
satisfied. While we concur that the aumbers are statisticaily different in a purely 
analytical analysis. we do not believe the difference to be “significant” in the non- 
statistical use of the word. Our Likert scale is not so exact as to firmiy conclude that 
there is a difference in a mean or 4.6 and +.1, because we surveyed opinions, which 
cannot be so precisely measured. We consider the difference in satistaction to be slight. 

ut still worthy of mention. In that light. reasons for the difference are presented in 


Chapter [V. 


EB VARIABLES 


a. Setting 


Miemumveved preferences for two Settings: 
* with or without a computer/GDSS 


* face-to-face or distriputed meetings 
1. Need of computer 


fiewmion- Gower ouos wereweresented (he statement: {his case ts better 
foeeae? fa computer «the GUSS groups were presented the statement: “This case is 
better solved withour a computer’. [n order to compare the two results, we «iil change 
the GDSS groups statement from “without” io “with” and reverse the questionnaire 
data according (which will actuaily look the same on the dot plot since the GDSS 
groups responses were symmetrical on this item). 

ine mull hyoothesis.1s: 

» Hp: There wiil be no significant difference between the face-to-face non-GDSS 
groups and face-to-iace GDSS groups in their opinion regarding soiving this 
case with a computer. 

The alternative hypothesis 1s: 


2 H,: There will be a significant difference between the face-to-face non-GD9SS 
groups and face-to-face GDSS groups in their opinion regarding solving this 
case with a computer. 
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VERY SATISFIED WITH NUMBER OF CRITERIA IDENTIFIED 


NoneGDSS groups 


= cee oes ce oes oe es we oes es SP oe oe oe oe ee oe oe oe oe 5 ee ee = = = om om oe oe ome one ous — < - 
L eee 3 = = 
disagree agree 
N MEAN MEDIAN TRMEAN Sih BY! SEMEAN 
36 4.55506 5 10000 4.5625 QO. 5040 0. 0840 


GDSS groups 


+See Sco see ee Soa eee Bs 
BR fo 5 ~ S 
dilsagree agree 
N MEA MEDIAN TRMEAN IDEV SEMEAN 
26 4.083 +. 000 4.156 Ossi SO) Puieio rs 
aE Dis c SLiGnLSleatrerie ferences 
256 =e) ore O07 yes 


LThus reject in: 


Figure G2 Criteria Satisiacvon - tices 
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VERY SATISFIED WITH DECISION MAKING PROCESS 





Non-GDSS groups 


| : = 3 

! disagree 

| N MEAN MEDIAN  TRMEAN 
36 4.5833 3.0000 4.6250 


| 
| 
GDSS groups 
{ 


| sete eww ewe een Tee een ee = rae ewe 

: l 2 

| disagree 

| N MEAN MEDIAN TRMEAN 
36 4+,1it +. O00 2, 156 


16 
mS SS 


2eUSeTelece tg. 


Soy 
0. 747 


=) 


Dem tetcane Ditference? 








J evReA Uy lols gine. 


ys 


Decision Making Process Satisfaction : t test 


I AM VERY SALISFIED® WITH Tes PINACeRE SoU. 


Non-GDSS groups 





disagree agree 
N MEAN MEDIAN TRMEAN STDEV SEMEAN 


36 &, 444 4.500 4.500 OOO” Ol eae Ed. 


i 
i 
i 
i 
i 
i 
i 
d 
i 
4 
i 
i 
i 
i 
i 
‘ 
i 
i 
i 
4 
i 
i 


GDSS groups 


—— a ne re te 


_@ S = 5 
disagree agree 
N MEAN MEDIAN TRMEAN STDEV SEMEAN 
So 3.944 4.000 4.062 ad 241 O27 267 
| i _DE 2 SLONLE i Canc Dies onence : 
Zee 56718 25 Oke yes 


Thus reject Ho. 


ee 


Pigumesk. 4” | esuitSausiactionesteicst 


ye 


MY GROUP DEVISED A VERY GOOD SOLUTION 





Non-GDSS groups | 


t * 
2 ee - =e ow = =8 =8 8 §8 8 8° §S ee RS eS eS Se Re ee ee ee ee Se ee Se ee ee ee Se Se Se Se Se Se Se 


ke “ ~ = = 
disagree agree 
| ah MEAN MEDIAN TRMEAN STDEV SEMEAN 
| So 4,144 5. oo 4.521 Orme Ome 22 


veSS croups 


| va 2 3 - 5 
: disagree agree 
=a MES MEDIAN TRMEAN SABI D SEMEAN : 
356 4.15 +. O00 ae sO ON SIS OL W65 
ik mie c Saeoir1 Cantu oi =erence? 
L. 49 64.5 1.998 10 | 





iguneer.> Soiution Satistaction : t test 


He, 


THis 


CASE Sse Din 


SOLVED WITH A COMPUTER 





Non=-GDSS groups 





a 2 3 a 5 
disagree aqree | 

| 

N MEAN MEDIAN TRMEAN Say. SEMEAN | 
Se Z ome 5 7 818i. Zo iz 2 Gera @ | 








| GDSS groups (not addressed in 2270) -Woodbury Seva 
ah An oi ef @8 «8 «8 =e ee ee ee ee 
| BE 2 a - = 
: disagree agree 
| N MEAN MEDIAN TRMEAN CPD IIA SEMEAN 
| 1S S, OCo S000 es 000 ey O72 i 
| 
| | 
| ai DE .c Significanms Dizlierenger 
| = ale WA Sree, “2.045 no 
| | 
| x 2 | 
Thus accept Jp. | 
rigure F.6” Needioi@sinpiutemea (oSt 
ss seen in rigure F.6, there was mo Significant difference between ine w¥o 
groups in their perceived usefulness Cf a Compute, a1 tiectse ead (nice ema 


aypothesis 


Ho is accepted. 
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2. Face-to-face vs distributed 


The null hypothesis is: 


e Ho: There will be no significant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in their preference regarding a face-to- 
face setting. 

The alternative hypothesis 1s: 


e H,: There will be a significant difference between the face-to-face non-GDSS 
groups and face-io-face GDSS groups in their preference regarding a face-to- 
fice settin’: 


ie 


rigure F.7 shows Hp is accepted: both groups were equally adamant in 
their preference for a face-to-face meeting over a distributed meeting. 
o. Group Interaction 
We surveyed two interaction variables: 
* contribution acceptance 


e chance to be heard 
1. Contribution acceptance 


The null hypothesis 1s: 


* Hy: There will be no significant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in their acceptance, of a member's 
contributions. 

The alternative hvpothesis 1s: 

¢ H,: There will be a significant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in their acceptance of a member's 
cone OutiCnS. 

ys seen in Migure &.3. the null ayporhesis is accepted: both groups readiiv 


accepted inputs from their group members. 
2. Chance to be heard 


The null hypothesis ts: 


* Hy: There vill be no significant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in ther allowing group members an 
equal chance to be heard. 


The alternative hypothesis 1s: 


¢ H,: There will be a signiticant difference between the face-to-face non-GDSS 
groups and face-to-face GDSS groups in their allowing group members an 
equal chance to be heard. 
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BETTER SOLVED WITH COMPUTER BUT NOT FACE-TO-FACE 


Non-GDSS groups 


| N MEAN MEDIAN  TRMEAN STDEV SEMEAN 
36 Za0es Be OO ae OFS C. 374 O. 146 
GlsSsee2ours 
a A ee ee eee +m ene nee “ ae ne ee += 
| 1 ae 3 os =| 
| disagree agree 
MEAN MEDTAN TRMEAN DIE SHMEAN 
36 2. 06s 2.006 ZO Ee. ODZ Oo 
DE is Signi=ncant Pitsgemence- 
Sie, oy aida 1.999 n 


t 








a er 


a pi gt - ee 
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Mi GROUP COMPLETELY ACCEPTED My CONTRIBUTIONS 





Non-GDSS groups 


SS ee ee ee eee ee ee ee 


ae 2 3 4 S) | 
Cisagree agree | 
| 
{ 
_N MEAN MEDIAN TRMEAN STDEV SEMEAN | 
25 4.536" +. QOQO dou On S225 O. O904 | 
| 
: 
) | 
! | 
| 
[eae gLOuDSs | 
| | 
| : 
| 
, 
| 
| ; | 
ee ee = = = = =a om nme om ce > om oe om = es a + —_— = oR om om om om == = - - «= | 
i 2 3 4 E 
| disagree aqree 
| 
| bal 7 fn sol NG 2 "” ea tcl 
| N MEAN MEDIAN TRMEAN STDEV SEMBEAN 
a6 4. 206 a. OOO 5) S OF ae oreo gel 


[remem CanchDif ference? 
SL 2200 LO 


t4 
boU 

ix 

ct 


©) 
(a) 
‘a 
OO?’ 


La me K 1 


“AUS accept Ap. 


FISUTe 2s NeECeDICd Vine Commbulionsmatitest 
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Figure F.9 shows the null hypothesis is accepted; both groups very 


definitely allowed everyone an equal chance to be heard. 
c. Decision Task Criteria 


Three variables were surveyed in the questionnaires in order to ascertain the 
validity of the Energy [International case for GOSS research: 
# actual decision making situation 
@ . rcalistic case 
a  supportability 


fl. Actual decision making situation 


The null hypothesis is: 
* Hy: This case study could not be an example of an actual decision making 
situation in an organization. 
The alternative Rypernesis 1s: 
°» H, : This case study could be an exampie of an actual decision making 
situation in an organization. 
The null hypothesis is rejected. The case was rated by our participants as 
an exampie of an actual decision making situation (Figure F.10). However, we took 


exception with that rating, as explained in Chapter [V. 
2. Realistic case 


The null hypothesis is: 


~ 


* Hp: this case study does not seem realistic to me. 
The alternative hypothesis is: 
> ,: This case study does seem realistic to me. 
As seen in Figure F.1d, the null hyoothesis is rejected aw ewe asce vce irc 
OV OUr Darlicipants as realistic. Again, We took exception with that rating, as explained 
ime Giereven ive 
3. Supportability 
ihe nuil hypothesis is: 
¢ Hg: This case does not lend itseif well to support dy Co-oP. 
The alternative hypothesis is: 


* H,: This case does iend itseif well to support by Co-oP. 
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EVERYONE IN GROUP HAD EQUAL CHANCE TO BE HEARD 


Non-CDSS groups 





: ee ee ee ee ee a ee eee ee oe ree ew ee aw aw A ee eee oe oe "== 
ga mee ' - 5 

| disagree agree 

| N MEAN MEDIAN TRMEAN SYD SEMEAN 
| 36 4.6667 Ss. GOO 4.6875 0.247381 Oe Oy eet 


| 
GOSS groups 
| 


1 z 3 = S | 
Sbl = )cleastee agree : 
i 
N MEAN MEDIAN LSAMEAN Sinar V SaMEAN | 
| 36 gee Sua Sac 4719 ©§©6, 688 acl 
T DFE c Smomsr icant Dictference? 
J. 40 592.4 fae JO NOlG, nO 


| 
| 
| 
Haus accept cy. 





Pigtrerk J teauale@inamce to be Lleard : t test 


of 


EXAMPLE OF AN ACTUAL DECISION MAKING SITUATION 
Each dot represents Z points 





= um ae ww oe ou Se a ee oe eee a Se ee — oe oe oe ee ee ee oe 


(Ft 4- as @e @ 


i 2 3 4 i 
disagree agree 
N MEAN MEDIAN TRMEAN STDEV SEMEAN 
72 3.472 4. 000 oO: Son! Jig wales Qrre 
| 
t Git 2 | 
Sao yak ite (Sle), Thus reject Hp. 


| 
| ees Le 
| 

Figure F.10 Decision Making Situation : t test 
As seen in Figure F.12, Ho is accepted. This case does not lend itself weil to 
support by Co-oP. As discussed in Chapter IV, this is not a judgement against Co-oP, 
but one against Energy International as a case for this type of study. Consistent with 


the mode! proposed in Chapter V, this case is mot sullable lor Use witane Woo emucE 


less one with features: similar to Co-oP. 
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CASE STUDY SEEMS REALISTIC 
Each dot represents Z2 points 


~J 
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if 
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Co-oP Supportability : = test 
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